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FOREWORD 


Tus ISSUE OF THE REVIEW represents one of the new areas planned by ne 
Editorial Board in February 1938 and February 1939 when the list o 
topics for the fourth cycle was reorganized. The issue was designed P 
cover aspects of education, particularly of instruction, which are genera, 
as contrasted to particular levels, subject fields, or specialized interests. 
In this sense it has no predecessor, though two of the areas which formerly 
comprised the issue on “Psychology of Learning, General Methods of Teach- 
iagand Supervision” (June 1939, June 1936, and October 1933) are 
included. The,third area of those earlier issues, namely, “Supervision,” has 
now been transferred to the issue on “Teacher Personnel” (June 1940). 

A number of new topics have been included in the present issue. Topics 
which are presented for the first time as chapters are “Philosophy of Educa- 
tion,” “Radio and Other Auditory Aids,” “Visual Aids,” and the "Library. 
These topics have had scattered and somewhat Íragmentary attention In 
earlier issues, and such treatments will be found by consulting the indexes 
in the Review. 

In accordance with plan, the treatment herein accorded the curriculum 
and curriculum-making is restricted to general aspects. Work on the cur- 
riculum in individual subject fields is presumed to be treated in the several 
issues of the REVIEW which are devoted to these subject fields. 

Other issues of the Review which may be regarded as supplementary to 
the present issue in treating rather general aspects of education are “Organ- 
ization and Administration of Education" (October 1940) and “Methods 
of Research and Appraisal in Education” (December 1939 and December 
1942). 

Doucras E. ScATES 
Chairman of the Editorial Board 
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CHAPTER I 


The Curriculum: A General View 


WILLIAM L. CONNOR and RAYMOND WHITE 


Historical Perspective on the Curriculum 


Tus CHAPTER is devoted to a brief summary of some of the chief phases 
of research and creative thinking in the general field of curriculum-plan- 
ning and construction. The more important published studies since 1936 
are reported in some detail. Less important studies are summed up in a 
sentence and others appear in the bibliography without comment. It may 
be well to review sketchily the curriculum-revision movement—how we 
came by the curriculum we have, why we are trying to change it, and how 
we are going about it. ee 

Nearly 2,500 years ago there lived and worked in the city of Athens 
two overlapping yet opposing groups of philosophers. Chief among them 
were Socrates and Plato, on the one hand, and Aristotle on the other. 
Whatever else we may say of the work of the first two men, this, we think, 
would be generally accepted: Socrates and Plato struggled with the idea 
of making a choice of what was to be taught to young people in order 
that they might enjoy the good life and develop the ideal State. On the 
other hand, Aristotle set up a research organization—the first great educa- 
tional research organization in the world's history and perhaps the largest 
that has ever existed in the world—to discover everything to be known 
about literally everything, to organize it, and finally to write it into text- 
books, so that others might, by studying these texts, acquire universal 
knowledge. For a number of reasons, some too lengthy and others too 
obscure to report here, the Aristotelian philosophy prevailed; and from 
his time to our own, education has largely been a process of discovering 
facts and truth, or what passes for facts and truth, and the organization 
of this material into textbooks for study in the schools. As scientific and 
historical research, philosophical thinking, and creative writing have in- 
creased in the world, the bulk of the world's knowledge has grown until 
the textbook has tended to become a compendium of knowledge in its 
given field, briefly and abstractly stated, and impossible of comprehension 
except by scholars highly trained in each field. 

About the turn of the century there was a revival of the study of Socrates 
and Plato and the beginning of new philosophies based, in part, upon them 
and their thinking and, in part, upon the facts of the social situation as 
they present themselves in the modern world. Perhaps the most prominent 
philosophy that arose out of this ferment was the philosophy of pragma- 
tism: That which works is true; and, in psychology, atomistic behaviorism: 
Human learning is simply the conditioning and progressive reconditioning 
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of one reflex after another, in detail, until a behavior pattern is formed for 
the adult. The revival of the ancient philosophy of Socrates and Plato 
and the development of pragmatism and behaviorism resulted in a few 
new textbooks and courses of study presenting elements of choice in terms 
of personal and social usefulness and detailed analyses of subjectmatter 
arranged for step-by-step learning of those details which were supposed 
to be true because they were observed to be useful. : 

A little more than a decade ago, four new elements were injected into 
the picture: (a) Philosophers who believed in absolute truth reasserted 
themselves as realists and began to compete with the pragmatists for con- 
trol of curriculum-planning. (b) Psychologists began to discover that the 
physiological basis of behaviorism was untenable—that the central nervous 
system acts dynamically as a whole—and they proceeded to demonstrate 
experimentally a dynamic theory of learning, characterized by the presenta- 
tion of interesting or “dynamic” material stimulating immediate, almost 
automatic, organization of ideas into thought and action, and leading to 
efiot-3nal drives sufficient to bring about the mastery of less interesting or 
actually inert Shaterial. (c) City and state school systems, as well as 
experimental schools, began to set up organizations to revise the curricu- 
lum or to plan wholly new curriculums. (d) Textbook writers began to 
write new textbooks to carry out the proposals set up in such new cur- 
riculums. Needless to say, city and state organizations have been variously 
led and have adopted strange combinations of all known philosophies and 
psychologies to guide their work. 


Current Criteria for Selection of Subjectmatter 


Out of this welter there are beginning to emerge a few principles, partly 
philosophical and partly psychological. on the basis of which curriculum 
materials can be chosen: (a) Social. Those facts and principles should 
be chosen for teaching which are most likely to enable the learner to 
master his environment, or to adjust to it, in the interests of the good 
life for him and for society. Some persons forget subjectmatter in their 
enthusiasm for the belief that social goals are to be achieved almost wholly 
through democratic living in the school. (b) Psychology of Learning. 
Of any two or more facts equally useful, that one should be chosen for 
the approach to learning which is inherently most interesting or, when 
properly presented, most "dynamic," that is, most likely to lead to a 
prompt, almost automatic, organization of ideas into thought and action 
and an emotional drive to attack less dynamic or even inert related mate- 
rials. (c) Testing. Standards of performance and tests for measuring them 
are being revised in terms of What pupils of known intelligence can 
achieve when given better curriculum materials and better teaching. Eval- 
uation of growth along desirable lines by systematic observation is sup- 
plementing testing—in some cases, replacing it. Attempts have been made 
to test “whole growth” resulting from “whole activities” —knowledge, 
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skills, intangibles, and so forth. The new “eight-year” or Aikin experiment 
tests are examples. (d) Functional Activities. Functional activities are 
treated not as disciplines but as life problems here and now and are useful 
in training for today and tomorrow. Community resources are much uti- 
lized. The ability to think is judged to be the best preparation for life. 
Facts and skills take relative places in the picture, with ability to think 
being primary. 

One may, however, examine the whole body of published literature on 
the curriculum and on curriculum-planning without discovering much 
positive evidence of the clear emergence of these ideas. In fact, the reverse 
philosophy and practice, or contradictory philosophies and practices, still 
hold in most quarters. This means that little objective research has been 
done—primarily, because there is no dominant guiding philosophy. This 
chapter on the review of research and creative thinking is presented, there- 
fore, as a brief description of a rather confused transitional period from 
which it is hoped that clearer philosophies and better practices mey, dn 
the next decade, emerge. e 


Recent Philosophical and Analytical Treatises 


Dewey (39) clarified his philosophy by explaining the meaning of 
experience, freedom, activities, discipline, control, and the place of subject- 
matter in a positive philosophy of education. Contrast and comparison of 
progressive and traditional practices serve to bring out vividly his phi- 
losophy of experience—continuous and interactive—as both the means 
and end of education. The book is no defense of progressive education but, 
às a restatement of a fundamental point of view, it may serve to save 
those who are attempting to work out a forward looking program from 
Some of the pitfalls of the ultraprogressives. 

Bode (14) pointed out the inadequacy of the concept of democracy as 
being that political organization which permits an individual the greatest 
freedom. Democracy, according to Bode, is a way of living by the group 
for the good of the group. The section which states the implications of 
education for democracy as a way of life also presents a point of view 
for the curriculum worker. 

The school must undertake to exemplify in its organization and procedures, its 


Conception of democratic living. A à : i 

he primary obligation of a democratic community to its members is to provide 
for each the opportunity to share in the common life according to interest and capacity. 
(14:77) 


The materials taken from the surrounding environment and the proce- 


dures in the school 


- are designed with reference both to the discovery and exploitation of individual 
QUY and to a continuous deepening sense of membership in the social order. 
14:83) 
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It [the school] must not merely practice democracy but must develop the doctrine 
so as to make it serviceable as an intellectual basis for the organization of life. (14:94) 

Morrison (91) defined the general curriculum as the curriculum of 
the common schools and estimated the time required to cover it. To Mor- 
rison, the curriculum is the sum total of all the common activities of all 
the people, and all these activities should, sooner or later, find themselves 
in the schools, regardless of whether that is possible at the present net 
Morrison analyzed the common activities which should be in the schoo . 
This analysis is presented in terms of subjects to be taught and is dis: 
tinctly Aristotelian in its outlook, although modern subjects and new 
phases of all subjects are presented. T. 

Bobbitt (13) made a fresh attempt to analyze society, and the good life 
in society, as the basis for the curriculum. He carried forward his rs 
and the presentday rebellion against the mediocrity of education conducte 
through subjectmatter as determined largely by Aristotle, and, since his 
day, fixed upon the schools. x 

Bed (96), in the first pronouncement of the Educational Policies oe 
mission, called for educational leadership to reconsider the obligations o 
education to our democracy. The Founding Fathers considered education 
the heart of democracy but were prevented by the exigencies of the time 
from making it so. During the period of Jacksonian democracy, education 
developed with the growth of the states into state systems with an emphasis 
on the development of the individual. It has largely followed this pattern 
until the present time. Let education, says Beard, assume its unique func- 
tion of preparing youth to live in a democracy. 

Hopkins (63) believes the good life is achieved by living it. The cur- 
riculum thus becomes those experiences necessary to live the good life in 
the school. They are to be selected cooperatively by teacher, parent, child, 
and all others capable of entering into the picture. The individual assumes 
responsibility for group activity and willingly takes his part in it. Learning; 
class and school administration, organization of curriculum experiences, 
and measuring of outcomes are discussed in the light of this basic philos- 
ophy of education. 

In Progressive Education at the Crossroads, Bode (15) stated: “The 
progressive school cultivates an atmosphere of activity and freedom all its 
own . . . isa place where children £o, not primarily to learn, but to 
carry on a way of life." (15: 9) Bode identified progressive education with 
the rise of the common man. He warned that it must cease to be absorbed 
with the development of the individual pupil and must be guided by a 
social ideal—the democratic way of life. 

Profitable growth in our day is grow! 


topsy-turvy world and such growth mu: 
Which in one form or another, 


th toward a plan for living intelligently in a 
st have reference to the issue of democracy, 


is cropping up everywhere and which is, by all odds, 
the most important issue confronting us at the present time. (15:85) 


He does not wish to depart from teaching the child as a person, but, as 
he sees it, teaching today lacks social direction and this "participation 
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in a common life is an essential condition for enrichment of experience." 
Group planning, socialization, projects, and similar innovations point to 
this essential ideal of a democratic way of living. 

Progressive education has a unique opportunity to become an avowed exponent 
of a democratic philosophy of life, which is the last remaining hope that the com- 
mon man will eventually come to his own. (15:122) 


The first part of the book by Hopkins and the Committee on Integration 
of the Society for Curriculum Study (62) gives the evidence for integra- 
tion in its biological, philosophical, psychological, and psychiatrical 
aspects, each by a specialist in his respective field. In the light of the prin- 
ciple of the integration of behavior, various types of curriculum organiza- 
tion and practices are evaluated. The traditional subject type of curriculum 
has least integration; then follow in order the correlated, broad-fields, core, 
and experience curriculums. While the experience curriculum offers great- 
est opportunity for integration of experience, and there is a trend in this 
direction, the author seems disturbed about guidance, because it is, in his 
Opinion, synonymous with education; also he appears to have quelo 
about the practical aspects of administering the experience Program. 

Lee and Lee (81) wrote to help the elementary teacher develop a cur- 
riculum better suited to his children. Proper guidance of child learning 
requires an understanding of the child as a purposing, growing individual 
with a personality all his own. The first section of the book discusses the 
child. The second part of the book gives suggestions for curriculum change 
in the various areas of experience—social, number, scientific, health, and 
creative, These suggestions serve as guides to the teacher and at all times 
give the impression that he is the “director of curriculum” in his own class- 
room, 

Mossman (92) presented a brief account of the history of the “activi- 
ties” point of view in curriculum development, together with an interpreta- 
tion of it. She showed that this point of view has been steadily gaining in 
educational thought and practice since the time of the Renaissance, con- 
tinuing up to the present day. It is not a fad but a steady growth which 
has probably not yet reached its peak of maturity. . 

Rugg and others (113) reported that their survey of the social, economic, 
and political background of presentday America shows great changes in 
American democracy. The authors drew up a balance sheet of assets and 
liabilities to indicate the promise of democracy in America. Democracy 
and education are interwoven—each dependent on the other. The position 
of youth in a “depressed” society is not favorable to desired growth. The 
school has lagged in making adjustments to offer satisfactory educational 
Opportunities. The last two sections are particularly important for cur- 
riculum reorganization. The first of these is a discussion of the growth 
Process and the relationship of the growth of the individual to the culture 
of the race. In the second, the authors discuss “promising efforts" for cur- 
riculum reform and indicate directions for progress in the years just ahead. 
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Rugg (112) described how mass education grew in the Meque "ed 
when frontiers were being rapidly expanded. In the period that fol p , 
education lagged behind progress in other phases of our national life. Thus 
education, which was designed to perpetuate and give impetus to our m 
tional life, was failing in its mission. Rugg does not favor what he nae 
"administrative tinkering" but a thoroughgoing readjustment of the schoo E 
program. In his school, activity holds a prominent place. The illustrations 
of the new program in health, social studies, and art are indicative. ; 

Schoenchen (120) reported that the activity school is *the result ofa 
slow growth of pedagogical doctrine and practice to which the most ee 
types of educational movements have contributed.” The author sees a 
method of the activity school as “heuristic,” to which he seems to E 
general meaning of helping the child find out for himself as far as possi . 
rather than being told. Pupil activity is formally and systematically T 
plied to teaching procedures. The rather lengthy criticism of Dewey s n 
cept of the activity school seems to be a matter of fine distinctions rat 7 
thapsreal differences. The writer relies more on prescription and less o 
freedom than qmost progressive educators would favor— "the teacher 50 
manipulates the learning situation that the pupils will choose the activities 
which the teacher has pre-selected for them to choose.” 

In The Changing Curriculum, Harap and others (97) presented an at- 
tempt to get a “glimpse of the distant scene” of curriculum reorganiza- 
tion and to appraise progress on certain programs of curriculum planning 
in action. The first part of the book is a discussion of the current status 
of curriculum thinking as regards its basis in the good life and its organi- 
zation in functional units of experience. The analysis of certain state, 
county, and city programs of reorganization includes a description of each 
program with some criticism in the light of the 1 
first chapters of the book. The committee presents a dynamic approach 
to the problem. There is unity in the basic principles underlying curricu- 
lum reorganization, according to these authors, and these principles. are 
well illustrated in the examples of programs in action. At no time is it 
intimated that we “have arrived," but the challenge to teachers to work 
on the curriculum is clearly pointed out. g 

Washburne (136) described the philosophy and practice of education 
as it is carried out in the Winnetka schools. Throughout the book there 
is an attempt to justify the Winnetka program. One who has followed the 
plan in Winnetka for many years can see changes—changes which bring 
about somewhat more freedom. However, essentially the plan has been, 
and is, one of prescribed minimum essentials with considerable freedom 
in some broadening activities. The “essentials” consist of knowledges, 
skills, or conventions which the child will use—not may use. The sections 
of the book which discuss the recognition of the child as a person are 
valuable for curriculum reorganization. The democratic viewpoint in school 
administration is well stated and sound. In such a democratic setting cur- 
riculum reconstruction could have freedom. 
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Everett (43) described nine community school programs. Four of these 
are in urban centers and five are in rural communities. These centers vary 
in many respects but in each case the community school is the center and 
an integral part of the community life. The philosophy underlying the 
program, the organization, activities, and evaluation are given for each 
program by a person intimately connected with the plan. These programs 
give many avenues for making the school a community project through 
combined school-community planning of curriculum, organization, and 
administration. 

Horrall and his co-authors (64) are workers in Lincoln School in San 
Jose, California. They have made changes in an elementary school to bring 
about a more vital program. Their experiment is more important because 
their pupils are not favored either in ability or in social or financial back- 
ground of parents. They were somewhat below the “garden variety” level. 
The building was an old one. Teachers were average, except for an interest 
in doing something about their mediocre program. These facts mak@the 
results of experiment more applicable to most schools. Magy progressive 
experiments have been in schools highly favored in teachers, quality of 
Student, materials, and building. The evaluation of the experiment seems 
sound. Achievement showed more than normal growth as measured by 
standardized tests. Other evidences, as fondness for the school, creative- 
ness, health habits, secondary-school success, and citizenship abilities, 
showed excellent progress on the part of the pupils. The book contains 
complete descriptions of units of work as they were developed in the 
School. 

Spears's book (125) is valuable as a clear presentation of the directions 
in which curriculum revision seems to be going. After challenging teachers 
to do something about curriculum development, six types of curriculum 
Plans of organization are clearly described. Overlapping among the types 
is recognized, but the classification serves as a frame of reference for the 
discussion of the type programs which follow. The discussion of actual 
Programs in action constitutes the larger part of the book and seeks *to 
reveal the specific steps certain schools are taking to arrive at the goals 
promised by the spirit of the movement" (125: 72). 


Research on the Curriculum 


. The studies reported up to this point are philosophical—creative or 
interpretative thinking—or they are descriptive. Three objective studies 
are now to be reviewed. 

In the Story of the Eight-Year Study, Aikin (1) reported the results 
of the Eight-Year Study under the auspices of the Commission of the 
Progressive Education Association. The Commission had two purposes in 
mind in making this study: (a) to establish a relationship between school 
and college that would permit and encourage reconstruction in the second- 
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ary school; and (b) to find, through exploration and experimentation, how 
the high school in the United States can serve more effectively. 

The findings of the study show that the graduates of the thirty schools 
were not handicapped in their college work, that departures from tradi- 
tional patterns of prescribed subjects did not lessen the student's readiness 
for college work, and that the students from the schools which made the 
most change in the curriculum made the best showing in college. The 
evaluation was scientifically carried out. It involved careful matching of 
1,475 pairs of students and following them through the four years of col- 
lege work. The “cards were not stacked” in favor of the experimental group. 
The data which describe the graduates of the thirty schools as contrasted 
with the graduates of traditional school have much meaning for the cur- 
riculum worker. 

Two implications come from this study: (a) Traditional patterns of pre- 
scribed courses are not essential. “The customary relations of school and 
gollege are unsound in that emphasis is placed upon out-worn symbols— 
units, grades, rankings, and diplomas. . . . The conclusion must be drawn, 
therefore, os the assumptions upon which school and college relations 
have been based in the past must be abandoned” (1:119-19). (b) Sec- 
ondary schools can be trusted with greater freedom in matters of curricu- 
lum than colleges now permit. “If some in the colleges feared that the 
Thirty Schools would use their freedom recklessly, they now know that 
their fears were without foundation" (1: 124). 

The counsel given by the thirty schools reflects current thinking on the 
organization and content of the curriculum. The approach to the whole 
problem is vital and realistic. To illustrate: “It is only when these para- 
phernalia (school buildings, classes, texthooks, courses, and credits) of 
education can be pushed into the background of one’s mind that realistic 
thinking becomes possible. Only then is the teacher able to see the stu- 
dent as a young human being growing up in a very complex and difficult 
world. And only then can the teacher begin to see clearly and construc 
tively what the school should be and do” (1: 130). 

In 1935 Wrightstone published a monograph entitled Appraisal of 
Newer Practices in Selected Public Schools. It attempted to appraise out- 
comes in certain newer and older types of school programs by “more ac 
curate and reliable measurements than have appeared in articles and ad- 
dresses by earnest proponents of either newer or older practices.” Wright- 
stone’s present study (144) supplements the older one by extending the 
number of objectives studied by more inclusive descriptions of the practices. 
Origins and development of experimental programs of education, from 
the latter part of the eighteenth century to the present time, are described. 
Instruments for appraising the experimental programs are explained. Six 
communities in metropolitan areas cooperated in the study—communities 
representing both the newer and traditional practices. Pupils in the com- 
munities were equated by the “matched pairs” technic. Teaching groups 
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were comparable as to such items as salary, experience, training, and 
pupil load. Data were secured to see how well each type of school is achiev- 
ing the objectives of elementary education. The results indicate that, if 
the objectives selected are valid, “the practices in the experimental schools 
are more conducive to more comprehensive growth than practices in con- 
ventional schools” (144: 220). There was a marked growth in the experi- 
mental schools in many of the “intangible” abilities, including desirable 
social relationships, appreciation of worthwhile activities, aptitudes, and 
critical thinking. In command of common knowledge and skills, the dif- 
ference favored the experimental schools, though the difference was not 
statistically significant. 

Saylor (117) analyzed the factors associated with participation in mod- 
ern programs of curriculum development, using as the basis for his study 
the state of Virginia, where a statewide program of curriculum develop- 
ment, introduction, and use has been in operation progressively since July 
1, 1931. His most important conclusion is: “Two factors emerge frem gll 
the evidence of the study as being basic to extensive participation by local 
school systems in a state cooperative curriculum program of the type or- 
ganized and developed in Virginia—leadership and, relatively speaking, 
high economic ability to finance schools" (117: 233). 

Perhaps the felt need in communities of relatively high economic ability 
is usually such as to make them reach for higher teaching ability and more 
dynamic leadership than communities of relatively lower economic ability 
can envision. A number of studies deserve brief mention because of their 
bearing on curriculum problems. Rainey and others (106) in How Fare 
American Youth? reported on the problems which youth face today. Bell 
(10) reported on the economic and social conditions and the attitudes of 
Some thirteen thousand youth in Maryland. Taken together, these two 
Studies are the proper source material for important changes in the cur- 
riculum. Dale (36) reviewed various studies of children's questions and 
pointed out the significance of such questions for the development of cur- 
riculum material. Carr (94) reported excellent examples of school prac- 
lice in education for democracy. Hollingworth (60) presented an enriched 
curriculum for rapid learners; Connor (31) summed up the story of the 
education of gifted children, with emphasis on the plan in operation in 
Allentown, Pennsylvania. Featherstone (44) described the newer type of 
activities applied to slow learners. 

Charters (26) showed how areas of experience are replacing subjects 
in the reorganization of the curriculum; Caswell (24) emphasized the im- 
portance of stressing contemporary problems to be solved cooperatively; 
and Brooker (16) called attention to the motion picture and the radio as 
potential educational tools. Oberholtzer (99) evaluated an experiment with 
an integrated program and showed that the pupils pursuing such a program 
achieve more than children in the conventional school. Wrightstone (145) 
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: . " " 
proposed criteria for the evaluation of state programs of curriculum r 
organization. 


Conclusion 


The present reviewers believe that the last decade, and perhaps po 
more the last four years, has been a rather confused, transitional pum 
from which it is to be hoped that a clearer philosophy and better researc 
may, in the next decade, emerge. 


Jd. 
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CHAPTER II 


Organization of the Curriculum 
FRANK A. BUTLER 


Oncssizarios or INSTRUCTIONAL MATERIALS designates the sequence in 
which educational experiences unfold during the process of learning. In- 
structional materials have commonly been organized by subjects within 
which the chronological and logical sequence determined the order of 
development. For ages subject lines have characterized the organization 
of instructional matter. The psychological as opposed to the logical ap 
proach has changed the sequence somewhat in many instances, but this 
change has generally occurred within subject boundaries. Deviations from 
the logical and rigid organization by subjects and within subjects typify 
the recent attempts to provide a different and supposedly better kind and 
séquence of educational experiences. 

Opinions differ widely as to the merits of any particular arrangement 
of materials. Bagley (3) stated: “The Essentialists have always emphasized 
the prime significance of race-experiences and especially of organized 
experience of culture—in common parlance, subject-matter." Kilpatrick 
(16) believes that, “To base a curriculum on a scheme of set subjects is 
for most children to feed them on husks; the plan here advocated is de- 
vised to bring life to our youth and bring it more abundantly.” 


Broad Fields of Study and Areas of Living 


Dillinger (7) stated, in the recent revision of the Missouri curriculum: 
“The Missouri program is committed to a philosophy of general education 
at the secondary level. The planning committee believes that it is desirable 
to organize the general program around certain life problems. It believes, 
however, that these problems can be developed most effectively within 
certain large learning areas, rather than in a program which abandons 
all subject divisions.” He then listed the broad learning areas as (a) lan- 
guage arts, (b) social studies, (c) mathematics, (d) health and physical 
education, (e) nature sciences, (f) practical arts, and (g) fine arts. 

Indiana (23) held to the basic subject fields but revised the organiza- 
tion within fields. Social studies materials, for example, are selected and 
organized to conform to the areas of experience appropriate for study 
on a particular level: first year, adaptation of individuals to group, home; 
and school life; third year, understanding life in the broader community; 
sixth year, understanding the contributions of the Old World to American 
ways of living; junior high school, group life and problems in the com- 


1 Various forms of ad 
discussed in “Or; 
October 1940. 
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munity and state and in the United States; and high school, group life and 
problems in the Eastern Hemisphere, in the Western Hemisphere, and 
problems of citizenship in our own country and in other parts of the 
world. 

Characteristic of several state and community revisions is the determina- 
tion of areas of human activity. The Mississippi Program for the Improve- 
ment of Instruction (19) has nine areas: (a) “Protecting Life and Health,” 
(b) “Making a Home,” (c) “Conserving and Improving Material Con- 
ditions,” (d) “Cooperating in Social and Civic Action," (e) “Getting a 
Living," (f) “Securing an Education," (g) “Expressing Religious Im- 
pulses,” (h) “Expressing Esthetic Impulses,” and (i) “Engaging in Rec- 
reation.” These nine were selected after a study of thirty-eight classifica- 
tions as derived by research investigations, students of society, and educa- 
tional leaders. The nine areas serve as a basis for defining the general scope 
of the core curriculum and the centers of interest or emphasis. Similar areas 
of human activity characterize a number of other state curriculums, for ex- 
ample, Virginia, Missouri, and Indiana. e 

Jacobson (12) wrote that the faculty of the University d? Chicago High 
School *feels that a vital reorganization of general education within the 
framework of the present subject matter departments can be achieved . . . 
it would include correlation as a method of teaching whenever or wher- 
ever it has meaning." Frederick (10) made an examination of books, re- 
search investigations, courses of study, and articles relating to research 
in curriculum construction, 180 of which were carefully selected and 
Studied. He found that during the last two decades the combining of sepa- 
rate subjects into broad fields, such as science, mathematics, social studies, 
and language arts, and the correlating of work in different subject fields 
Were two of the trends frequently mentioned. Broad subject field organiza: 
tion in general education rather than separate subject organization within 
a field is reflected clearly in the studies of the Commission on the Secondary 
School Curriculum (24). The needs of youth should determine the source 
and the organization within the broad fields. 


Organization in Terms of the Problems of Youth 


Organization of learning experiences that disregard subject lines is prob- 
ably the most recent innovation. Aikin (1), reporting on the Eight-Year 
Study of the Progressive Education Association, described the endeavors 
of a group of thirty secondary schools to organize experiences on a different 

asis in general education or the core curriculum of the thirty experimental 
high schools and the effect of this training upon later success in college. 
“Almost all the schools were trying from the beginning of the Study 
to find ways of breaking down the artificial barriers which unfortunately 
Separated teacher from teacher, subject from subject.” Schools most experi- 
mental in nature deviated most widely from the attempt to “put subjects 
together." Stress was “upon the problems which young people face while 
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they are still young people, upon the concerns of Pigh aghan — 
while they are still in high school.” This stress was upon "prob md E 
"concerns," with disregard to subjects as such. Aikin reported 2 à 
pairs of students were studied—those entering college in 1936. ce aa 
years; those entering in 1937, for three years; those entering in l aa 
two years; and the class entering in 1939, for one year.” A pair — m 
of one student from one of the thirty experimental schools and one stud en 
who entered college in the traditional college preparatory manner. weed 
conclusions are: “It is quite obvious from these data that the Thirty Schop e 
graduates, as a group, have done a somewhat better job than np m 
parison group whether success is judged by college standards, by Haan 
dents’ contemporaries, or by the individual students. The graduates s rd 
most experimental schools were strikingly more successful than. th A 
matchees . . . students from the participating schools which made mo 

fundamental curriculum revision achieved in college distinctly higher 
standing than that of students of equal ability with whom they were s 
Pred... the assumption that preparation for the liberal arts colleg 


depends upon@he study of certain prescribed subjects in the secondary 
school is no longer tenable.” 


Unit Plan of Organization 


A decade ago Billett (5) found that unit organization of materials was 
one of the three general ways of providing for individual differences in 
secondary schools. Today’s educational literature on the unit is astound- 
ingly voluminous both in the discussion and production of units. y 
Morrison concept (20) of unit organization has expanded to mean ‘al 
things to all men.” Whatever the external framework of recent organiza- 
tion may be, the internal arrangement is generally in terms of units. Unit 
organization is actually inherent in any arrangement wherein terminology 
includes topics, problems, or projects. A unit encompasses logical or 
psychological approaches. From blocking a subject off into logical and 
unitary divisions all the way to treatment of areas of experience of vital 
concern to youth, the unit has stretched and held its name intact. 

Frederick (10) found there was a "trend for the core curriculum to be 
organized into units of experience based on significant situations, phases 
of life, interests and needs of pupils, or problems which pupils now face 
or will face in the future.” Mackenzie (18) reported that secondary 
schools in California which had made significant progress in reorganiza- 


tion of their programs in the core curriculum used the unit organization 
within subjects or in problems of life or areas of experience. 


Activity Programs and Organization 


While no standardized sequence of school experiences holds in activity 
programs, there is the tendency for these programs to deviate little or much 
from the customary subject treatment. Dissociated from the pure activity 
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in learning, the programs include topics, imaginary trips, projects, prob- 
lems, units, and other ways of organizing experiences in terms of pupils 
needs, interests, and abilities. 

Jersild and others (13) reported on one of the early evaluations of the 
large-scale experiment with the activity program in the elementary schools 
in New York City. They defined activity education as a “program based 
upon units of pupil activity as a substitute for and supplement to the tradi- 
tional textbook learning." This experiment was started in 1935 in seventy 
elementary schools and continued for a period of six years. The report 
is based upon evaluation of eight control and eight activity schools com- 
prising Grades IV, V, and VI. Early testing indicated that “activity classes 
consistently surpass control classes in quality of cooperative, critical, 
experimental, leadership, and self-initiated activities; children in the ac- 
tivity classes lag appreciably behind children in the control classes in 
Some of the educational outcomes which are measured by an achievement 
test of academic skills, mainly arithmetic and spelling.” Morrison (21) 
also reported on a follow-up survey of the New York City Activity Progean? 
made by the state education department by request from the Bew York City 
Board of Education. A fuller statement appears in the chapter on “Ac- 
tivity Education,” which follows. The Progressive Education Association 
Committee to report on evaluation of newer practices in education (25) 
found that “where schools have adopted newer educational practices the 
children learn as much of the ordinary school subjects as they would other- 
wise have learned. Sometimes they learn slightly less and sometimes 
slightly more, but the differences are small. . . . Where any measures have 
been applied, there is a definite gain in terms of initiative, skill in deal- 
ing with problems, knowledge of contemporary and world affairs, and 
Social participation." 


Organization of Courses of Study in Three Fields 


Bruner (6) had access to eighty-five thousand courses of study on file 
In the Curricular Laboratory and Library of Teachers College, Columbia 

niversity. His study, which covered a period of five years, was limited 
to an analysis of the outstanding courses in social studies, science, and 
industrial arts from 1930 to 1940. His findings were as follows: 

Science—Emphasis on the logical development of subjectmatter, with 
Ns resulting narrowing effect on scope, was most noticeable in the special- 
ized sciences, namely, physics, chemistry, and biology. All the courses in 
Seneral science, with the exception of one, tended to emphasize functional 
Values, with a resulting greater attention to social applications than to 
Predetermined sequences. 

Social studies—Kight types of social studies organizations were found: 
a) separate subjectmatter organization (overwhelming majority of the 
729 courses fell in this category); (b) correlation between and among 
iflerent social studies areas; (c) correlation with other subjectmatter 
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areas; (d) modern problems organization; (e) broad-fields organization; 
(f) core curriculum organization; (g) guided experience organization 
(teacher guidance); and (h) pupil experience organization (growth of 
pupils through experiences in which they are keenly interested). 

Industrial arts—The internal organization was of three types: (a) for- 
mal arrangement or combination of skills, processes, or knowledges; (b) 
sequential projects prearranged; and (c) project differentiated to meet 
individual needs. 


Organization for Academic and Nonacademic Pupils 


The Research Division of the National Education Association (22) re- 
ceived questionnaires from 1,062 secondary-school principals who ex- 
pressed their opinions pertaining to provisions that should be made for 
superior students. A large proportion believed that superior students, 
whether in separate or regular classes, should be given especially enriched 
programs of work; the material should not be merely more of the kind 
given to average students but mainly the kind that will deepen and 
strengthen theft understanding of the world and which will stimulate their 


superior powers of reasoning and invention. Opinions about ability group- 
ing were evenly divided. 


In their study of provisions for the educationally neglected (nonaca- 
demic, slow-learning) pupils, the National Association of Secondary-School 
Principals (8) advocated the development of modified courses and dif- 
ferentiated programs for the college preparatory, commercial, and edu- 
cationally neglected pupils. Attempts to “dilute” the conventional subjects 
to suit individual differences have proved unsatisfactory. 
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CHAPTER III 


Activity Education 


KATHARINE B. GREENE 


Spread of Philosophy of Activity Education 


Acrwrry EDUCATION has spread rapidly during the last several years, 
as findings from the fields of psychiatry, psychology, and education have 
permeated the ranks of educators. The objective of education is now often 
seen as the development in individuals of a spirit of independence in solv- 
ing the problems of life, through experiential understanding of the be- 
havior and motives of themselves, their fellows, and the community; the 
development of rules in the attack on these problems; and the cultivation 
of attitudes for the confident approach to these problems. Locke's theory 
of th@abula rasa is at last being supplanted by the theory that the child 
is an active, reactive individuality, unique in himself—a theory which in 


American education can be traced primarily to the teaching and philosophy 
developed by John Dewey. 


This change in educational principles has not been adopted wholesale; 


in its very nature it cannot be imposed from without. It has seeped through 
our educational program, appearing in many different places in estab- 
lished systems, as individual educators have become convinced of its 
validity. Usually it has come into conflict with dominant patterns of 
authoritarian discipline and frequently it has been the source of emotional 
conflict between its adherents and those who believe in the establishment 
of rule, authority, and discipline for the sake of discipline, 

With its emphasis on the value of individual thinking and adaptation to 
the actual situation of each problem, the philosophy underlying activity 
education appears in as many different guises as there are situations and 
workers. It is therefore impossible to summarize the work done in rules 
which are universally applicable. Only the philosophy is general, while 
each educational application differs from every other application. No one 


stated application can be called the only true activily education. If educa- 
tional practice becomes crystallized, we shall no longer have true activity 
education. 

Since the Deweyian philosophy has seeped through to education from 
various points, there are many different levels of progress in its educa- 
tional application. Some learning situations have just begun to respond 
to its influence, some are well enough along so that descriptions of them 
are available, and few of them have reached the level at which it is pos- 
sible to compare results through analysis and research technics. 
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Working Concept of Activity Education 


Since activity education appears in many different guises and on dif- 
ferent levels, the following definition of limits has been used to determine 
what falls in this field. It is activity education when the teacher and 
children who are in the learning situation do the planning of the curricu- 
lum, select the methods to be used, and appraise the results, while all 
the administrative, research, and special resources of the school and com- 
munity are called upon for help, but do not interfere by determining from 
outside exactly what is to be taught and how. In activity education, the 
center of thinking about educational problems and their solution is within 
the group, all other individuals and groups being secondary, revolving 
around the center. Better forms of activity education consider the com- 
munity and appraise results realistically in terms of community value, but 
are not coerced nor hampered arbitrarily by conclusions of outsiders. 

A rough rule of thumb for measuring quality of education in the pe 
is to measure growth and change in the teacher, for no mal ter how ae 
the group may ape forms of activity education it is not rea if the uei 
comes out at the same point at which he entered. There is much spora ic 
activity education carried on in standard schools, within eei Pee as 
posed by the requirements of the system and the community: good " EN 
under any system have believed that each child was an individua =) 
have stimulated him to draw conclusions from his own experiences. 
real loss to educational advance has been that often the teacher is not 
encouraged to continue his growth and that of the children, but is ham- 


pered by criticism and pre-formed judgments. 


Treatises and Reports on Activity Education 


ivity education in general are De Lima 
4 , Lane (24), Melvin (30), 
d descriptions of practice 


Recent authors dealing with act 
(13), Heffernan (34), Leonard and Eurich (25) 
and Washburne (35). These volumes give goo | dE aN 
in individualized activity schools, with general explanations : un eee 
theories, It is possible from these summaries to compare tec! hnics and re- 
Sulis on a subjective basis. There are more limited reports which give 
Practical advice in showing how activity education is carried on, as in 
Educational Method (14) , Heise (17), and the San Diego monograph (41). 
In New York City, the Speyer School did early experimental work with 
the activity program. The conclusion of Pritchard and others (39) based 
9n the work with slow learners was that there was no noticeable improve- 
ment in ability of slow learners through the methods used then. An article 

Y Burton (11) gives a general summary of current educational attitudes 
loward activity education, and Baker (40) summarized activity educa- 
lion for the lay reader. 
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The New York City Experiment 


This is the largest experiment in elementary activity education which 
has been carried on and evaluated by accepted research procedures, It 
has been reported in numerous articles (18, 20, 21, 22, 28, 29, 31, 42, 
47, 49). The final Statements made by the research workers carry weight. 
Jersild, Thorndike, and Goldman concluded (21:308): 


While the control children seem to have a slight but statistically unreliable advantage 
as far as achievement in academic subjectmatter is concerned, the activity children 
surpass the controls in the frequeney with which they exercise such presumably 
wholesome activities as leadership, experimentation, self-initiated enterprises, partici- 
i iscussion and the like. The activity children have more experiences 
and show more tangible accomplishments in the fields of the aris and crafts. The 
activity children, as already noted, also tend to be superior in tests that call for 


e involved in the Wrightstone tests of working 
skills, explaining facts, applying generalizations, current events, what you believe, and 
personality reported in the main body of the present study, 


5 Mürrison's survey (31) gives statistical tables for comparison of results 
in activity an& nonactivity schools for mastery of skills and knowledge in 
the sixth school year; educational growth in fourth, fifth, and sixth school 
years; attitudes and behavior of the children; teachers and the activity 


program; and parents and the activity program. In the summary (p. 162) 
it is stated that: 


In the mastery of knowledge and skills, three conclusions are supported by the 


data reviewed ... : ically reliable differences between the two 
programs favor the activity procedure and 


regular program. 


One of the standard complaints about a 
ervers is that it is disorderly and child 
authority. Morrison (31: 163) stated: 


ctivity education by casual ob- 
ren are not learning to respect 


With regard to the development of such attit 
at present, Morrison reported (p. 162f) : 
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activity schools like school better, find it more interesting, and tend more to carry 
its influence into their life outside the school; (2) pupils in the activity schools 
tend to excel and in some cases by reliable differences in such qualities as coopera- 
liveness or working together, self-confidence or poise, lack of subservience, creative 
abilities, self-discipline and scientific outlook; (3) in developing respect for the 
authority of home and school, the two programs are almost evenly matched in the 
outcomes, 


There is no attitude that the problem is solved and can be pigeonholed. 
Morrison (p. 164) said: “Much attention needs to be given to improving 
the activity procedure even in those schools that have been committed 
to its development. . . . Before they undertake its practice, teachers and 
Principals need to give careful consideration to the theory of the activity 
program; yet a thorough understanding of its objectives is possible only 
through practice in trying to attain them in the school’s work. . . . Teach- 
ers need expert assistance in obtaining mastery of the methods and tech- 
niques of the activity procedure.” 

Experiments on the Secondary and College Levels a o? 


Activity education has been described by a class which went through 
Ohio State University High School (36). The students reported (p. 296) : 
We have never had the feeling of having education handed to us already to be 


absorbed, but have been stimulated to the desire to learn, discover things in our 
own way, and think for ourselves because it will be necessary for us to be 
* Dart of a democratic order, our teachers feel and have made us feel that we should 
egin to think and do for ourselves while we are young (p. 298). Because of the 
fact that we do not have a required amount of work, it would be possible for 
"S to continue most problems indefinitely. This makes us feel that we could always 
Eo further and that our work is never finished. . . . Discipline has never been 
a very grave problem in our school, and we, as students, have never been very con- 
Sclous of it. There is not a long list of hard-and-fast rules, but individual problems 


are taken care of as they arise. 


The work of the Progressive Education Association in the Eight-Year 
Study (1) is the most extensive in the secondary-school field, involving 
thirty schools whose application of the principles of activity education 
Tanged from slight variations of standard forms of education to radical 
Innovations. Since college entrance is a recognized goal of high school, 
the experiment could not begin until some three hundred colleges agreed 
to accept graduates of cooperating schools on more flexible terms than are 
Usual. Now the Association hopes that other secondary schools will be 
Sranted this same freedom to develop curriculums in keeping with the 
needs of students and the community. The Association proposes that, until 
colleges organize their own purposes and know what candidates should 
Present to fit them for college, restrictions on high schools be lifted; that 
what is needed for college preparation should be worked out by high 
Schools and colleges cooperatively; and that needed information about 
Students should be presented to colleges by high schools through some 
Means other than issuing certificates that certain courses have been taken. 
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The thirty schools say this about curriculums (p. 138) : “First, every 
student should achieve competence in the essential skills of communica- 
tion . . . and in the use of quantitative concepts and symbols. Second, 
inert subjectmatter should give way to content that is alive and pertinent 
to the problems of youth and modern civilization. Third, the common, 
recurring concerns of American youth should give content and form to 
the curriculum. Fourth, the life and work of the school should contribute, 
in every possible way; to the physical, mental, and emotional health of 
every student. Fifth, the curriculum in its every part should have one 
clear, major purpose.” 

Dean Hawkes reported on the college success of students from the 
experimental secondary schools (1: 149 f) : "On the whole, the students 
from the Thirty Schools were superior to the control group. . . . So far 
as these data are significant, the students from the schools whose pattern 
of program differed most from the conventional were very distinctly 
gu to those from the more conventional type of school." 


Lack of Apfropriate Research Technics 


The. greatest amount of reported material on activity education is on 
the descriptive level. Here the work is still tentative and subjective judg- 
ments are necessarily used in appraising results. Research in many cases 
is hampered by several restrictions, There are too few students studied 
and far too short a time to justify statistical analysis; also there are too 
few research tools for the study of planned purposes of activity education. 
The lag in development of research tools means that while we are able 
to test adequately acquisition of knowledge (which is the goal of authori- 
tarian education) comparing children’s achievement in pues A with 
c in school B, in arithmetic, spelling, 
or reading, we cannot so readily compare the extent to which children 
have reached goals stressed by proponents of activity education. There 
are too few tools developed for mea 
cooperation, intellectual interest, scrutiny of a situation for its true 


values, liking and understanding of individuals with different patterns 
of living, willingness to see and 


knowledge of when to use tools 
of them. 


(17), Jersild (19; 22, Part 2), Lane (24 ippi ffer 
materials which may be worked u rcbus ue 


Bingham (8), Finley (15), Heise (17), Jones (23), Lewin and others (26), 
Morrison (31) Murphy (33), and Wrightstone (49) give examples of 
various methods of measuring results which are stresse 
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than by nonactivity education. The development of research tools other 
than academic and intelligence tests, to measure contributions to growth 
of children by activity education, is a very necessary next step before 
further evaluation will offer us much new light on the comparisons of 
activity and nonactivity (or standard) educational procedures. 


The Teacher and the Environment in Activity Education 


While the teacher may be the most potent single force in the child's 
education, he is not the only one. There is a strong trend in activity edu- 
Cation to recognize this fact. Teachers who wish to understand effects of 
the out-of-school environment on their children will find the work of 
Skodak (43) stimulating although later work does not confirm all the 
data. The influence of evacuation Írom danger areas was discussed briefly 
ata meeting of the British Psychological Society (10). The influence of 
Gestalt psychology on the study of social relations has great significance 
for activity education. Children's responses to democratic and authari-@ 
tarian group atmosphere, described by Lippitt (27), shewed marked 
differences in favor of democratic procedure in producing good social 
behavior in the children, efficiency in production, and continuing interest. 
Authoritarian procedure, however, was not a duplicate of the situation in 
the world in general, since the children did not feel that the sanctity of 
tradition was on the side of authority and did not feel that sense of service 
to an ideal which the authoritarian movement has sometimes successfully 
Invoked, UN 

Lewin, Lippitt, and White (26) have studied aggression under differing 
Social conditions, An article by Zachry (50) considered effects of psy- 
chiatric interest on education, while a more theoretical article by Frank 

6) clarified the impact of the social milieu on individual growth. 

rescott’s book (38) is source material needed by every activity teacher 
°r understanding his function. While much psychiatric technic is not 
available for thy láyman the educational process itself may be used for 
Promotion of good mental health. Articles by Finley (15) on class struc- 
ture, Bender (7) on group activities, and Curran (12) on art, all point 
ut methods of atilizine educational facilities for analysis and improve- 
Ment of mental health. "The meeting of the British Psychological Society 
a Tepresents a study of children's problems in wartime, the recognition 
of which will alter the attitude of teachers toward children in peacetime 
Education, 
any standard elementary schools have gradually adopted activity 
Procedures from successful methods used by nursery schools. Since authori- 
arian pressure to cover ground and impart information has not weighed 
RS heavily on early elementary years, it has been easier to introduce new 
methods Without censure. Centers for the study of preschool children have 


8 : 3 
= a trained workers whose influence on educational practice has been 
arked 
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Learning Is Many-Sided Development 


Three generations ago, in the United States, education beyond the first 
three or four grades was largely considered as professional a ue e" 
Sixty years ago it was not possible to obtain a free secondary-sc 100. 
education in Brooklyn. When formal schooling was so limited in pur- 
pose, the majority of our population got their real education outside 
school. Now our free schooling has been extended to care for all educable 
persons well into the teens, but there is still a division between what a 
majority need and what schools offer. The idea that we are concerned wit 
more than intellectual processes can be traced to the work of G. Stanley 
Hall. The *whole child" is a phrase which denotes at least lip service to 
this concept. Another analysis of children's problems in education was 
summarized by Olson and Hughes (37) as “Organismic Age.” Olson’s 
results showed that the learning rate is affected by several factors besides 
the commonly accepted one of ability. Jones, Conrad, and Murphy (23, 
‘25 )otraced the relationship between development in emotional and social 
fields and leaSning. For all those who wish to follow developments in this 
field, the work of Murphy (32, 36) is an excellent guide. Strang (46, 48) 
offered a guide for teachers who wish to apply available technics to the 
study of children whom they are helping, while Jersild (19, 20) pres 
sented a picture of the teacher as a “whole teacher" (as children sce him) 
and Brewer (9) presented tools which may be of use to the teacher in 
measuring his own effect on children. Bell (6) outlined some consider- 
ations of the nature of children and the learning process which teachers 
should know, and Stoddard (45, 47) drew conclusions as to relations 
between findings in child psychology and educational theory from his 


experiences in both fields, Research in development during early ages 
is exemplified by Anderson (3 


), Barker (4), Murphy (33), and 
Updegraff (48). 
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CHAPTER IV 
Philosophy of Education 


FREDERICK S. BREED 


Decline of Opposition to Philosophy 


Ox: WOULD HAVE TO BE AFFLICTED with a species of mental blindness who 
has failed to observe, during the past generation, that the reputation of 
philosophy among educators has been clouded with suspicion. Indeed, 
education as a field of study is not alone in this respect. In numerous areas 
Where scholars ply their craft, the feeling has spread that philosophy 
represents a futile approach to the solution of the problems of the world. 
The “speculations” of the metaphysician have been unfavorably contrasted 
With the verifications of the scientist, and students in considerable ram®er 
have turned their backs on philosophy, preferring to aofept the faith of 
leaders who grew up in the same tradition as themselves and as unencum- 
bered with a knowledge of the subject. For better or for worse, however, 
the resistance to philosophy is perceptibly weakening. The barriers to 
philosophic study are being swept aside. Evidence that a change of attitude 
is taking place can be found in the organization of the Philosophy of 
Education Society in 1941; the publication of the Forty-First Yearbook 
of the National Society for the Study of Education, Part I (3, 6,11, 14, 15) ; 
and the decision of the editor of the Review to admit a chapter on this 
subject, 

Prior to these events a situation developed that had a more deterring 
effect on the opposition than any of them. This was the unmistakable 
demand for improvement of the instructional approach in the classrooms 
of the country, reflected in the progressive movement, and the fact that the 
Principal inspiration for this demand had its origin in philosophy. It 
shortly dawned on intelligent observers that the experimentalism upon 
which the new movement was based had a broader foundation than the 
experimentalism of educational science as currently pursued, that the 
reform under way could not be properly appraised until it was understood, 
and that it could not be understood without a degree of competence in 
Philosophy. Thus seems to be explained the recent rejuvenation of philos- 
Ophy as an educational discipline, a discipline that in no way impugns the 
findings of science but, on the contrary, takes them wholeheartedly unto 
Its bosom. 


Numerous Philosophies of Education 

_ Before entering into a discussion of the broader foundation for educa- 

tional thought provided by philosophy, it seems proper to devote a 
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moment's consideration to the title of the present chapter. One may cham- 
pion the value of philosophic reflection, and indeed have a cherished 
philosophic outlook of his own, but still lack the presumption to offer this 
outlook as the only hope of salvation for educators. The possessor of the 
outlook may believe nothing less, but others will easily be found who 
believe something else. Accordingly, no trace of dogmatism lurks in the 
title for the chapter; the caption is intended only to suggest a deep felt 
need for a clarification of the basic ends of democratic education. Tt implies 
a latent confidence that by giving thought to this problem, with all the 
resources of knowledge available, the major purposes to be achieved in the 
schools can be brought into clearer light so that energies now scattered 
may be focused for their realization. 

For years Dewey was so exclusively prominent as an educational philoso- 
pher that it was natural for many to conclude th 
education they knew was the only philosophy 
I»wey made no claim that his instrumental pra 
philosophy of @lucation. Today educators are in 
before to appreciate the meaning of this fact, th 
cations as Brubacher’s recent volume 
National Society referred to previous] 

The pattern of a sound educati 
from one’s philosophy of life, an 
fundamental forms or combinatio; 
in the annals of philosophy and 
instrumentalism, scholasticism, 


at the only philosophy of 
there was. But even then 
gmatism was more than a 
a better position than ever 
anks to such timely publi- 
(7) and the 1942 Yearbook of the 
y. 

onal philosophy is logically inseparable 
d the latter may take any one of several 
ns thereof. These forms are quite familiar 
go under the names of idealism, realism, 


and the like. The differences that obtain 
among these viewpoints stem mainly from different conclusions about the 


nature of the knowledge process.’ Since this process, known otherwise as 
the thought process or the process of reflection, is central in education, 
it is clear enough that the same differences in theory of knowledge will also 
mark off the leading points of view in general educational theory. 


Possibility of Greater Agreement 


It is significant that while all the contributors to the recent National 
Society yearbook on the ph 


y ; ilosophies of education agree that respect for 
personality, for individuality, is the primary educational principle in 4 
democratic State, they diverge considerably on the nature of religion an 


on that extremely crucial topic, the nature of value, general 
as well as educational, 


+The writer has discussed the 
referred to, p. 87-138, 
their common enemy, 
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is is a piots of difference between instrumentalism and realism in the yearbook 
- This is a family q 


warrel which is forgotten by these empiricists whenever absolutis™s 
appears, 


June 1942 PHILOSOPHY or EDUCATION 


It is apparent that the present situation in the field of educational 
philosophy calls for a high degree of tolerance and patient comparison 
of views. It is surprising that Brubacher (6) did not find more points of 
resemblance among the different educational philosophies which he exam- 
ined. As discussion proceeds, however, it is not too optimistic to expect 
that points of difference that spring, as many do, from lack of information, 
misinterpretation of fact, inconsistency of thought, and the miscompre- 

. hension of opponents will tend to disappear. If so, areas of agreement 
should be enlarged as the various outlooks are more fully explored. 


Persistence of Fundamental Differences 


Exploration has already gone far enough to show, however, that the 
leading outlooks on the world and education are each founded on relatively 
few fundamental propositions known as assumptions or presuppositions. 
Such propositions are neither God-given revelations nor absolute truths 
achieved by human intelligence, say the empiricists; they are but gerfera 
zations from experience—hypotheses, if you will, suppé?ted by belief. 
It is not difficult to see how such fundamental principles operate in the 
lives of those who take them seriously. They naturally give rise to different 
Ways of looking at life and education. The devotee of the Absolute lives 
in a world serenely guaranteed, where all is well from everlasting to 
everlasting, even if he occasionally leans back in his easy chair, lights up 
à cigar, and takes a moral holiday. By the same token the pantheism of 

ary Baker G. Eddy excludes the reality of evil and explains the familiar 
attitude of the faithful toward error and disease. Similarly, the scientific 


determinist has no room for ethics in the sphere of human relationships, 
mechanical world controlled throughout 


9T it consistently disappears in a d 
and prag- 


Y natural causation, as he defines it. In contrast, many realists 
matists have achieved a deserved reputation for being tough- rather than 
lender-minded because they are consistently prepared to face the tribu- 
ations of the universe with no greater revelation than natural knowledge, 
no better guide to conduct than human intelligence, no more certain guar- 
antee of salvation than human effort. For this variance philosophers are 
'sparaged in certain quarters, even though physical scientists in the same 
Manner and for the same reason hold different hypotheses regarding the 
nature of light, biologists are divided on the causation and extent of 
Yeredity, and psychologists are at odds concerning behaviorism, the pro- 
Posals of the Gestaltists, and the nature of consciousness itself. 


Democracy Must Decide 

The moral of these examples is not far to seek. They suggest clearly 
enough that the facts in our possession are not everywhere susceptible of 
an unequivocal interpretation. Important controversial issues still divide 
the ranks of scholars in all fields, and with the differences in concepts are 
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correlated differences in practice. Where an issue is thus in doubt, a democ- 
racy can either allow competing views to flourish unmolested in the spirit 
of an easy tolerance or by majority vote select and reject as seems most 
beneficial for the interest of society. It is a mistaken notion to believe that 
education should proceed according to the doctrine of laissez faire while 
economic and political interests are being subjected to control. Education 
functions as a part of the general social fabric. The national system of 
education should be analyzed with a view to determining the major ends 
to be achieved, and these ends, with popular approval, should become the 
distant goals of instruction in the schools, subject always to modification 
dictated by experience, including, of course, the results of research. 
Unanimous support for an objective is no more necessary in education 
than it is in politics. In either case, the opinion of the majority should 
prevail. The important democratic consideration is the open door to truth, 
the essence of a true progressivism. 

At this juncture the reader may be disposed to scr. 


d“opine that the immediately foregoing statement has a peculiarly 
familiar ring.^"I have it,” he may finally affirm, as a faithful memory 
harks back to the scholasticism of Mortimer Adler echoing through the 
racy ironical pages of The Higher Learning in America (12). It is true 
that we are anticipating a more definitive, a more positive, organization of 
public education, just as Hutchins is striving for a similar reform in 


higher education, but with a distinction in methods of approach that marks 
a tremendous difference. 


atch his puzzled head 


The Decision of the Modern Scholastics 


the philosophy of St. 
it is built on the philosophy of absolutism. 
nent and interpreter of this philosophy- 
s ely with the educational applications. The 
received acclaim from the high priests of 
mism figures so prominently in the official 
ch (15). The program of reform has been 
2 valism because it is a reversion to scholas- 
It is also a reversion to Aristotelianism through St. Thomas 
Aquinas. 


. In the Hutchins proposals empirical thinkers, 


group in education, can find much to approve. E 
approach, on the historic contributions of hum 
integration of college departments, and ev 
plan need not be occasion for alarm to empiricists, or so it seems to the 
writer. But many of the most Progressive adherents of this philosophy 
stand adamant against the metaphysical core curriculum proposed for 
adoption at the University of Chicago, 
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Empiricism versus Absolutism 


The frustration of the reformers on the home front is a direct result 
of a serious clash between two fundamental philosophies of life. Adler 
and Hutchins make a sharp distinction between philosophy and science; 
their empirical opponents make no such distinction. With the former, 
philosophy provides a technic for laying hold of absolute truths, with the 
latter, the principle of induction is still the foundation of all knowledge, 
and the relativity of truth its natural and accepted consequence. Accord- 
ing to the empirical doctrine, philosophy is but a venture in the direction 
of greater generality of thought. The “clear and distinct ideas” that pass 
with the absolutists as revelations of the cogitation of Almighty God are 
regarded by the empirical group as impressive examples of self-deception 
and misinterpretation. The latter group are yet to be convinced that there 
are any self-evident truths in the sphere of term-thing relationships, which 
includes the basic knowledge of science. This is not to say that basic 
relationships discovered by experiment and expressed in mathenticel 
form may not be used by an Einstein for the discovery & relationships 
hitherto unknown. This technic is a commonplace with mathematicians. 
But the conclusions reached can never be more secure than the facts assumed 
as a basis for the proof, and these are characterized by their relativity, 
Which means that they are subject to revision as research proceeds. 4 

Some of the obscurity that hangs over this theoretic struggle like a 
fog can be dissipated if the crux of the problem js more definitely iden- 
tified. To the writer the fundamental issue arises from different concep- 
lions of the nature of value. This statement of the problem covers not 
only the value of truth but value in general. Adler charges that the br 

ay empiricists (*positivists" to him) have brought modern cu 2 to 
the brink of ruin through their impotent skepticism. He is irked by their 
insistence on applying scientific rules of evidence to his proposals for 
their redemption, when the fundamental values of human experience, 
according to him, are not empirically established. These er bons 
the ends, objectives, or goals of education, hence the general alarm im 


educational circles. 


An Empirical Theory of Value 


The empirical conception of the determination of value can be briefly 


*Scribed, even if it cannot be adequately discussed, within the narrow 
confines of our allotment of space. To avoid ambiguity it should be ob- 
Served that the term “value” is commonly applied to that which is valued 
as well as to that which confers the status of value. Let us abstract, for the 
moment, from the question of determining what objects or, more broadly, 
€xperiences are valuable, and note, if we can, how their value is achieved. 

n what, the question is, does their value reside? . . 

Let us hark back for a moment to the value of truth. A truth is a belief, 
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say the empiricists, that has been verified by experience; but the verifi- 
cation is not the evaluation, else the professor who bases his profession 
on useless knowledge, without professing to do so; would never have 
won his present unenviable distinction in comedy and the comic strip. 
Value as known this side of heaven is a product of human reaction. 
Nothing, as far as known, seems to have value in itself. The attitude of 
man to an object or event determines its value. Value, that is, is attached 
to an object by virtue of a type of external relation to humans. Funda- 
mentally, a thing is said to have value if it is attractive to humans; and 
that is attractive which attracts. Some empiricists express this basic notion 
in terms of interest (17); others employ such terms as preference or 
desire or demand, but no divergence of view worthy of note is reflected 
in the phraseology. Pursued somewhat further, the roots of value are 
found hidden away in the reactions of selection and rejection, in the 
positive and negative responses of the organism to the elements of its 
+ Yap It is appropriate, therefore, to speak of positive and negative 


u& For citizens of the United States democracy possesses the first; 
totalitarianism? the second. 


The Failure of Infallibility 


y with which we are concerned, it now 
the things that are valued. 


purportedly infallible reason 
g borrowed from the ancients, 


process in man, The modern 

little interest in the James-Dewey tradition in 
preferring exegetical studies of Aristotle, Aquinas, 
illuminate their pathway. Challenged to produce 


educational ends, “evident or self-evident truths 
that can be affirmed without demonstratio 


mode of procedure in a series of s 
doubt as the classic "proofs? 
esting, if not astonishing, to no 
with undiminished confidence, 
rests "upon certain evident tr al observation of 
existing facts.” It is not surprisi i 
effort with the admission th 


at “no adequate 
completed” (1). 


demonstrations have been 
Scientific Determination of Value 


The empirical school o 
of existing facts. Human 
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objects, known as the value relation. The situation can be symbolized in 
the expression A r B in which A and B signify the terms related and r 
represents the relation. All three elements in the situation are regarded 
as objective—discoverable existents in the external world. Hence, say the 
Scientists, value is a legitimate subject for objective investigation. The 
difficulties of research in the field are practical, not theoretical. The 
problem becomes one of identifying the fundamental interests of humans. 
The uncertainty of scientific truth is no sufficient warrant for deserting 
the scientific method. Interests lie in the open field of observation and 
are already being extensively studied. They will no doubt be more exten- 
sively studied in the days to come. Better and better ways will probably be 
devised for determining whether the individuals in a given group or in 
the nation at large are interested in a given objective, and whether they 
are more interested in it than in certain other objectives. 

An end, when and if achieved, is conceived as a state of human welfi 
a condition in social life. If one proposes prohibition of the sale of ito 
cating liquor on a nationwide scale, we are confronted with the question, 
How will it probably affect the general picture of social e? If depend- 
able data relating to its effects in this or other nations are available, these 
data are consulted first. Then are canvassed the considered opinions of 
Persons whose experience and training seem to give them a preferred posi- 
Hon as judges. Finally, with such information before them, the popula- 
lion in a democracy or its political representatives are polled. The vote is 
taken as an approximate measure of value. Thus in a democracy are 
political and economie ends selected, though seldom educational ends. 
The latter are usually left to representatives of the people in a legislature 
or a board of education, after a recommendation by an assumed expert. 

ut it is neither improper nor inconsistent with the democratic tradition 
or great educational issues to be taken to the people for decision. 

Which reminds me of an absolute idealist who created a considerable 
Stir in psychology during the early years of the present century—Hugo 


ünsterberg, It is painful to recall, for example, how mie iie d ae S 

Seminary, Mii iar i de grace to democrati - 
s a cou, gi 

Y, Münsterberg administered p derive the trii 


piment with the impressive assertion that one cannot d 
Tom a majority vote. And so, apparently, we did not in the yu 
adoption of prohibition. But nobody imputes clairvoyant insight to the 
maker of an American ballot. His vote for prohibition was à posse 
Teaction reflecting a readiness to undertake an experiment which might 
or might not eventuate in keeping with his evaluation. It is a privilege 
of à democratic citizen, as it is of a scientist, to alter his attitude as new 
ce develop. Thus values like truths, are arrived at by ae 

ether the democracy shall be “wet? or “dry,” indeed its form in general, 
We believe, should be determined by experiment. This is an impossible 
method for one who is obsessed with the infallibility of his own ideas in 

p discovery of ends and would be limited to the discovery of means. 
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A Crucial Educational Problem 


proposal to inquire into the fundamental principles of the various sciences 
and to investigate the interrelations among the sciences, with a view to a 
better grasp of the organization of human knowledge and thence of the 
foundation of the curriculum, indeed to organize a special faculty to 
conduct such research to this end, need not strike terror to the heart 
of any scientific educator. He should favor the extension of scientific 


study to the fundamental concepts employed or implied in his and other 
subjects. But this program of rese 


or scientific universe of discours 
international scale in the unity- 


Sgienfific interests lurks in the personnel of the “metaphysical” faculty. 
If the court ig packed with the cult of the infallible, the nature of the 
decisions can safely be forecast. 

If justification were needed for the rather 
Chicago situation, it may be foun 
this situation but also in the f. 
need for the type of fundamen 
as the philosophy of education 


lengthy discussion of the 
d not only in the wide interest taken in 
act that the problem involved suggests the 
tal inquiry which was hereinbefore defined 


Humanism and the Causal Law 


The pragmatism of James (13), the instrumentalism of Dewey (8, 9. 
10), the experimentalism of Kilpatrick (14), and the organic realism of 
Whitehead (19) are all empirical philosophies, They accept the unity 
of science and philosophy. They rely fundamentally on generalizations 
based on particular experiences, In fact, all four of these outlooks may 
be described as generalizations of the scientific method. Where they 
diverge one from theory, or elsewhere, the diver- 

i ying interpretations of available fact. Lastly, 
nay be described as humanistic, and so moral- 
f restrained optimism, but they are melioristic 
in their attitude toward human life and social problems, This means that 
of human betterment through 
inst a common interpretation of causality, 
vhich pictures measures of human uplift as 


m—as idle as a painted ship 
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scientific conception of natural causation and consistently believe in 
freedom, morality, and humanitarian effort? If there is no freedom there 
can be nothing deserving the name of morality, and endeavors toward 
human uplift become illusory incidents in a vast complexity of cosmic 
weather. The problem should be faced by every educator who prides him- 
self on the rationality of his outlook. 


Trend Away from Scientific Determinism 


The philosophy that underlies the notion of scientific determinism 
usually envisages a physical world composed of inert material objects 
related in a system of push and pull, attraction and repulsion, where man 
finds his place as one of the objects, possessed of a conscious life that 
accompanies events in his material organism as inertly as a shadow follows 
him in the sunshine. Essentially the same materialistic view colors the 
thought of one who believes in a universal “reign” of causal law. 

This approach to the problem has rapidly lost ground among many 
of the distinguished thinkers of our time. In the first plage, the concep- 
Es of matter as an inert substance or as a substance of any kind is now 
widely discredited. Whitehead reflects the trend of modern thought in 
the view that there are no “vacuous entities.” Moreover, human vassalage 
rl "» "reign of law" tends to disappear with the modern conception 
ou. belena is descriptive rather than explanatory. The law of a 
te xample, is descriptive in the sense that it merely expresses the spatial- 
EUM relations observed when bodies fall. To say that gravitation 15 
the cause of the event observed is a prevalent and peculiar inversion 


of thought. A law of gravitation, expressed in mathematical form, is a 


€scription of the behavior of an entity in relation to another entity. 
of an electron or the 


"Pec ier the entity has the. relative simplicity ; t 
ve complexity of a human body, it can be conceived as an active 
p enibi possessing characteristic modes of behavior, modes of response 
° other entities, Science investigates these modes of behavior, but, ulti- 
Mie stands in baffled silence before the question, What explains the 
ction? The behavior pattern dictates the law, not the law the behavior 
ca The present program of science is complete when the form of the 
ity and its reaction system have been mathematically described. 


What Is Freedom of Conduct? 


A e: $ freedom in a world so constituted? 
external d entity SEEMS: to be satisfactorily 
Cümstan etermination. That is, one is free if 

i ces from acting as one wills. This but reaffi 


Vio " 

usly published, with which the chapter may be brought to a close: 

of oxygen explains in no way 
d recorded post rem. Do atoms, 
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In such a world the free- 
defined as the absence of 
not deterred by external cir- 
rms a conclusion pre- 


To di: 
the q 'scover what hydrogen does in the presence 


?In&. The event is simply found by science an 
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i vindi ks? What 
like the moon, shine from borrowed light? Are they mere unwinding clocks : m 
principle of rationality requires one to believe that energy is forever pies Paes 
elsewhere, or from some single pervasive source? The secret of that w hich es 
: " 
served is hidden away in the elements themselves, for aught that science Bos a 
i in way acting. m 
Thus are oxygen and hydrogen said to have certain ways of acting, certain 


S, 


behavior. Refer to them as bonds, or affinities if you like. These are theirs, ur apap 
so far as known, to nothing elsewhere, And, if the simplest element conceivable 4 
independently in the simplest way possible toward any other element, there is E 
dom of action. Freedom of action is freedom to act. It means the opportunity to 

in accordance with one's nature, the opportunity to be oneself (5). 


I. 


2. Breen, FnEDERICK S. Education 


& 


4. Breep, Frevertck S. “T 


15. 


16. 
17. 
18. 
19. 


. Breep, Freperick S. “Wh 


. Bnunacugm, Jonn S. * 


. Dewey, Jonn. Democracy and Education. New York: Macmillan Co., 1916. 434 p- 
. Dewey, Joun. Logic. New 


. Dewey, Jony. Studies i 


. Hurcuins, Rogert M. The Hi, 
9 


Bibliography 


" ion” j hies 
,M MER J. “In Defense of the Philosophy of Education. Philosop: 
oe Fory Fiat Yearbook, Part I, National Society for the Study of 


Education. Bloomington, Ill.: Public School Publishing Co., 1942. Chapter 5, 
p. 197-249. 


and the New Realism. New York: Macmillan Cos 
1939. 237 p. 


Rice», Frepertck S. "Education and the Realistic Outlook.” Philosophies ol 
Education. Forty-First Yearbook, Part I, National Society for the Study 3 
Education! loomington, Ill.: Public School Publishing Co., 1942. Chapter 3, 
p. 87-138. 


he Road to Objectivity in Education.” School and Society 
52: 81-86; August 10, 1940. 


at Consolation in the New Physics?” Scientific Monthly 
35: 347-51; October 1932. 


Comparative Philosophy of Education." Philosophies of 
Education. Forty-First Yearbook, Part I, National Society for the Study o 
Education. Bloomington, Ill.: Public School Publishing Co., 1942, Chapter 7, P- 
289-321. 


- BRUBACHER, JOHN S. 


Modern Philosophies of Education. New York: McGraw-Hill 
Book Co., 1939. 370 p. 


York: Henry Holt and Co., 1938. 546 p. 


T n Logical Theory. Chicago: University of Chicago Press, 
1909. 


- Horne, Herman H. “An Idealistic Pl 


hilosophy of Education." Philosophies of 
Education, Forty-First Yearbook, Part I, National Society for the Study 4 
€ od Bloomington, Il.: Public School Publishing Co., 1942. Chapter ^ 
p. -95. 


igher Learning in America. New Haven, Conn.: Yale 
University Press, 1936. 11 p 
James, Wittram, Pragmatism. New 


York: Longmans, Green and Co., 1907. 
- Kivpatricx, Wittm H, “Philosoph: 


E y of Education from the Experimentalist Out- 
look.” Philosophies of Education, 


McGucken, Wit, S. J. “The Philosophy of Catholic Education.” Philosophies 
of Education. Forty-First Yearbook, Part I, National Society for the Study 2 
Ill: Public School Publishing Co,, 1942. Chapter 6: 

p. 251-88. 
Martz, VELonus. "Philosophy and Science." 
search. (Edited by W. S. Monroe.) New Yor 


Perry, RALPH B. General Theory of Value. 
Co., 1926. 702 p. 


Encyclopedia of Educational Re- 
k: Macmillan Co., 1941. p. 795-98. 
New York: Longmans, Green an 


RussELL, BERTRAND, Sceptical Essays. New York: W. W. Norton and Co., 1928. 
256 p. 

Wuireneap, ALFRED N. Process and Reality. New York: Macmillan Co., 1929. 
547 p. 


298 


CHAPTER V 
Methods of Teaching 


STEPHEN M. COREY and VIRGINIA MOOK 


Tu: CONCEPT OF GENERAL METHODS OF TEACHING is so broad as to need 
empirical delimitation in any summary of research data. In one sense the 
teacher's method includes everything that he does in the classroom as 
well às the maintenance of many nonclassroom conditions that affect 
learning and over which the teacher has some control. Broadly conceived, 
SE of the teacher's instructional method might involve his ability and 
willingness to regulate the amount of fresh air in the room. The term is 
not so broadly defined, however, in the pages that follow. They sum- 
marize the research reported within the past three years which has been 
concerned with evaluating the relative effectiveness of certain gerr: 
procedures employed by teachers. The best practical defi@tion of these 
general procedures or general methods is the following list of names that 
have been applied to various ones of them—the activity method, the 
ES method, the conference plan, the demonstration method, the dis- 
cussion method, the laboratory method, the lecture method, the problem 
s ier the project method, the seminar method, supervised study, the 
- plan, and the recitation method. 
i tach of these methods has been variously described. One of the ohaptera 
n this Revirw is devoted entirely to a consideration of the activity 
method,” Consequently, the considerable body of literature in this area 
Sd M here. Inasmuch as any investigation of general methods alaya 
he ns MA particular instructional materials or subjectmatter, the 
pee ier and Spe ao rami ge 
ealing jm e three years 1939, 1940, ae : iehteen different 
ng with general methods were published. Under eightee 
€adings in the Education Index there were forty titles so worded as to 
Pru research, but of this total only fifteen reports actually PES 
Fir arl investigation. While there was a rather large o d o Hue 
the hs An Experiment with the Project Method, An iei ocu iie 
lion ay Method,” or “An Experiment n eee e 
Were not - dicis aem "x all confined themselves to 
iscuss; eported and the experimenters usually mds mnd desorübink 
ing the relative merits of the various methods a g 


subjectiva ; 
e : E 
Jective impressions of effectiveness. 


i 


Classification and Use of Various General Methods 


Monroe 4 : à 1 methods of 
i and Marks (12) classified the various general methods o 
teaching te n pue the following headings: (a) the 
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lecture method, which consists primarily of extended discourse by the 
teacher supplemented by assignments; (b) the recitation method, involving 
an emphasis upon extended questioning of the pupils by the teacher; 
(c) object teaching, or the frequent use of concrete, tangible objects such 
as animals, plants, and colored cards, which pupils observe and study and 
about which the teacher asks questions; (d) the developmental or Socratic 
method; (e) the laboratory method, in which the classroom becomes 4 
workshop furnished with the tools of living; (f) the project method, in 
which the pupil “purposes” to do something voluntarily or as the result 
of stimulation by the teacher and in which all the learning is related to 
this purpose; (g) the problem method, in which the teacher makes the 
assignment in terms of a problem and thus directs the situation; (h) the 
socialized recitation, which involves a considerable amount of teacher- 
pupil cooperation and extensive use of discussion technics; and (i) the 
Morrisonian unit-mastery procedure. This last is most commonly found 
at the secondary level and involves pretesting, teaching, testing the results 
of teaching, adapting the procedures, teaching and testing again to the 
point of actüal mastery. Monroe and Marks agreed that the distinctions 
many cases artificial and that 
her often employs a variety of 


- Bumatay (1) circularized a large 
number of teachers in Texas elementary and high schools to find out the 


tion were, in order of efficiency: student 
ominated general discussion, and workbook- 


Project Method 


A committee appointed by the Progressive Education Association (14) 


generalized favorably upon results from sixteen research studies concerne 
with the relative effectiveness of “newer” 


Lecture, Demonstration, and Discussion Methods 


Degering and Remmers (3) reported upon the relative effectiveness of 
individual laboratory work and the lecture-demonstration method in thé 
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teachi r 
oe chemistry to home economics students. While the 
found na i ruin ctas was approximate and subjective, the authors 
its adoption in = mE MES method was effective and they urged 
Gace with 3 is 1 the amount of money that would be saved in com- 
the a ot me in ividual laboratory method. A second investigation of 
withoa was pice aim method versus the individualized laboratory 
of shesiog. "Th mm by Steen and James (15) and involved the teaching 
eor lanae authors reported that. for high ability students the 
ability ane ration method was superior whereas students of lesser 
individual Iba more effectively when they were given opportunity for 
of ihe E rper wi experiences. A third study of the relative effectiveness 
Elder (5) in d monstration and individual laboratory work was made by 
opiñion bya mia The research data included mostly statements of 
beginning vim arge number of teachers, such as: Do you believe that 
work?” aid can be taught effectively without individual laboratory 
said “NG” en percent of the respondents said “Yes” and 84 pergeníp 
Pomi Da ndis method of presentation, Lohmeyer and pO (9) 
or developing Serres effectiveness of three types of oral presentation 
dren were dá unctional concepts and related attitudes. Sixth-grade chil- 
literature T! d and the following three content areas: history, science, and 
ond — ü three methods employed were (a) straight talk in the sec- 
tization. Th b) informal discussion using several voices, and (c) drama- 
Were slate conclusions were that the talk and dramatization methods 
all gro cantly superior with respect to all types of subjectmatter and 
ups of subjects. 


Group Discussion 

Miller ( 
Course in 
discuss 
Studen 
comm 
Order 
Coura 


Prob] 


cussion method in an advanced 
esponses for each 


ts wi ared the five best 

vith the five poorest students in terms 0 
Miller recommended that in 
teachers should (a) en- 
ey already have on the 
dents to locate specific 
tunities for the inter- 
information. Zeleny (16) 
f the small group dis- 
ith the more conventional large 
mer, the larger groups were 
five students each. All of 
ll group procedure, but in 
the difference statistically 
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o 
en 
own i 
Cleny’s iffe into several small groups of 
on] erences were in favor of the sma 


one out s 
of approximately twenty cases Was 
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significant. The students reported that they enjoyed studying sociology 
more when there was opportunity for small group discussions. 


Unit Method 


Ellwood (6) evaluated the unit-directed study procedure in the wer 
ing of modern history in high-school classes. His method consisted o : 
following cycle: presentation, directed.study period, discussion, e d 
test. A control group was taught by the traditional recitation method "€ 
special tests were constructed to measure understandings, attitudes, — 
ests, and skills. Despite the low critical ratios which resulted from " 
data, the author concluded that the unit-directed study procedure b 
apparently superior for developing understandings and skills, the ape 
tation method is evidently better for developing attitudes, but no defini 
conclusions can be drawn as regards interests, di- 

For a number of years Michener (10) has experimented with a mo K 

@ication of the Morrisonian unit plan. Thirty-three experiments were con 
ducted in vafous types of schools, using subjects from the pui wie. 
the graduate level and involving material from numerous subjectmat : 
areas. Michener's plan includes the following five steps which he belieg 
are not adequately emphasized by Morrison: group study, individuali e 
tion, generalization, action, and evaluation. The author concludes Re 

all grades, it seems especially we 

ses dealing with problems and in which m 

major objective is modification of behavior. The method is less successfu 
when used in connection with units in which the major objectives are 


appreciations or the acquisition of skills, Michener warns that the metho 
is useless in the hands of weak teachers, 


Individualized Teaching 


Olson and Kambly (13) investi 
three types of teaching upon th 
pupils: (a) &roup instruction, duri 


engaged in the same activity; (b) individ 


(c) a composite method, in which pupils went 

eceived help when they requested it. Tus 
ich youngsters were given indi 
it was most effective. 


pe 


June 1942 METHODS or TEACHING 


by memorizing and learning by understanding. The latter usually involved 
induction and was defined as “the organization or reorganization of 
the given material by the learner.” His experiments involved a great range 
of materials from tricks with cards and match sticks to an understanding 
of economic principles. His chief conclusion was that learning by under- 
Standing is superior to learning by memorizing if retention and transfer 
are the desired objectives. 


Conclusions 


A review of the research dealing with general methods of teaching might 
Well conclude with a quotation from the Encyclopedia of Educational 
‘esearch (2), “The experimental research relating to patterns of instruc- 
Hon is subject to a number of criticisms. The experimental factor is 
complex, in some cases curriculum reorganization being involved; the 
Control of non-experimental factors, especially teacher skill, zeal, and 
enthusiasm, is seldom adequate; the measurement of the outcomes ef io 
Struction is rarely satisfactory; and the period of exp&rimentation is 
usually not long enough for the pupils and teacher to become adjusted 
.° à new method. Furthermore, all the patterns of instruction are not 
‘intended to serve the same functions. For example, the arguments advanced 
on the “project method’ emphasize outcomes that are not claimed for the 
*eeltation method? and the ‘lecture method’” (p. 726). =) 

he authors of this chapter in the Review are of the opinion that the 
nsearch in general methods during the period under consideration has 
M been fruitful. They are convinced further that the teaching vidus 
$ 50 complex that attempts to establish the relative superiority or inte 

Y of anything so amorphous as a “general method of teaching" are 


almo P 1 : 
St certain to be indecisive. 
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CHAPTER VI 


Radio and Records in Education 


SEERLEY REID and DANIEL DAY 


Topar eran? OF THE HOMES in the United States contain radios, 

a iti one-half of the schools of the nation have radios. Most pupils, 

dae aee school without ever hearing broadcasts in the 

Yrs el i io is of value in American schools and classrooms in 
ays: 


radio stoom listening to school broadcasts produced by network organizations, 
2, Sens a universities, and local school systems. — — 
l:Glasaraom istening to educational records and transcriptions, — : 
hours, for ex or auditorium listening to general broadcasts on the air during school 
ample, speeches of the President or other public leaders, openings of 


ongre 
Hue symphony concerts, and news broadcasts. 


he i h 
hours, educational use in classrooms of programs 


e 
broadcast dyzing ccs 


5. Radi : 
adio courses, units, or clubs in science, speech, dramatics, social studies, and 


oth " 

"6 qubjectmatter areas. 
he presentati. 

Over lo, presentation of school sponsored programs, 
cal radio stations. 


usually with student performers, 


Li 
Hterature Dealing with Radio * 


of iine interested in developing an understan l 
o MAL entialities of radio as an educative medium, 

rst gro ent references. These may be divided into seven groups. In a 
radio a are various books dealing with the writing. and production of 
Probab ‘grams, as (7, 20. 79, 130, 152, 168). While such books are 
radio a LEA valuable to high-school teachers directly concerned with 

e Meus shops, they offer suggestions to all teachers interested in using 
p nics and methodology of radio in vivifying ordinary classroom 


roc i : 
"dures. A second group of references consists of radio dramas and 


radi x 
"ud discussions (15, 26, 27, 64, 83, 97, 98, 99, 150, 151, 166, 167). In 


a to plays there are available printed transcripts of such series as 
able „cas Town Meeting of the Air,” “University of Chicago Round 
The American Forum of the Air,” and “Invitation to Learning. 
tiie world crises and the prominence of radio news analysts and 
tory i] alors will undoubtedly increase the importance of a third cate- 
Nalists Nat of the personal experiences and interpretations of radio jour- 
- Already a number of such books have been printed (57, 61, 92, 


126 
> 127, 128, 129, 131, 138). In a fourth group are numerous books and 


ding and an appreciation 
there are a number 


Alth 
n ou, M m 
Umber Bh this is the first general treatment of radio and education in the Review there have been a 


vaer of E h 3 S 
gi E disce otia on radio in connection with particular phases of education. Studies reviewed in these 
: sio, i E ing: 
45: ns have been eliminated from the present chapter. For earlier treatments see the following: 

6: 315, 489; 4: 470. 


+10: 13, 118, 215, 434; 8: 36, 44, 383; 7: 68; 
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hlets which deal with the development of radio policies and prac- 
wen the United States, such as (16, 19, 37, 38, 46, 48, 66, 68, 93, 122, 
E there are publications of organizations devoted to the We 
of educational radio: the twelve yearbooks (1930-1941) of the Insti 
for Education by Radio, the five yearbooks (1931-1935) of the I pe 
Advisory Council on Radio in Education, and the three yearbooks (1 ek 
1938) of the National Conference on Educational Broadcasting; pamph ets 
and documents of such organizations as the Federal Radio Wducation r 
mittee (12, 39, 40, 41, 103, 104), the U. S. Office of Education, the "pw 
Advisory Council on Radio in Education (21), the Evaluation of yc 
Broadcasts (76, 77, 90, 101, 107, 108, 110, 111, 112, 113, 114, 116, 117, 
119, 124, 154, 155, 156, 160, 161, 162, 164), the School Broadcast Confer- 
ence, and the Committee on Scientific Aids to Learning; and regular 
bulletins and newsletters of the Federal Radio Education Committee (aa 
the National Committee on Education by Radio (95), the Bureau 4 
ducational Research (Ohio State University) (74), the Columbia Broa 1 
casting Syster (24), the Mutual Broadcasting System, and the Nationa 
Broadcasting Company (94). T 
In a sixth group are various magazines and Magazine issues dea Ing 
with radio—the three trade journals, Variety, Broadcasting, and Radio 
Daily (106) ; the annual volumes, Radio Annual (106) and Variety eem 
Directory (145); the miscellaneous “fan” magazines such as Movie ana 
Radio Guide and Radio Stars; and the newly established journal of the 
Association for Education by Radio. Entire issu 
have been devoted to the educational, 
aspects of radio (2, 35, 36, 59, 60, 102). . 
Seventh, there are various references devoted to the problems of using 
radio in school (10, 30, 41, 51, 54, 62, 65, 75, 96, 120, 159). 


es of several M xe 
psychological, and sociologica 


Research and Summaries of Research 


During the last ten years there have be 
dealing with the uses of radio in school and 


suggested by Charters (21) in 1934, 
concerned with petty problems and h 
Fortunately, however, during the las 
radio research projects 


—one at the University of Lacie: 
one at Columbia University (formerly a 
to answer questions puzzling broadcasters 


one at Ohio State University, 
Princeton) —have done much 
and educators. 
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In one of the best references on the methods of radio research, Lumley 
(78) examined with critical insight the research up to 1934. A year later 
Cantril and Allport (19) presented a series of investigations dealing with 
voice and personality, sex differences in radio voices, speaker versus loud- 
Speaker, listening versus reading, and effective conditions for broad- 
casting. Wrightstone (165), with the assistance of the Evaluation of School 

roadcasts staff, summarized the research up to 1939. Two issues of the 
Journal of Applied Psychology, February 1939 and December 1940 (59), 
both edited by Lazarsfeld and Stanton (69), presented research investi- 
gations completed during 1941. With so many investigations being carried 
9n throughout the country, Beville and Daniel (12) suggested a classi- 

cation of educational radio research. 
n Findings of the three radio research proje I a 
ollows: Many of the investigations of the Columbia (formerly Princeton) 

adio Project have been included in Lazarsfeld’s discussion (68). The 
results of the Wisconsin study have been summarized in a report by ne 
Ewbank, and McCormick (8). At Ohio State University, the findings 
the Evaluation of School Broadcasts staff have been publifhed in mimeo- 
Braphed form in approximately fifty individual bulletins. The. influence 
9f these Subsidized research projects upon graduate research is evident 
in the bibliography. 


cts have been published as 


Radio and Sound Equipment in Schools 
m The first nationwide survey of radio and sound equipment in schools t 
ade by Koon and Noble (63) in 1936. These investigators, I à survey 


= 82,997 schools, found only fourteen radio sets per one pe m 
m only one school in a hundred with a central radio sound system. 
Oo 


i ix s per 
u "oBraphs were more common, there being forty-six honapape x 
gp Yed Schools with, however, an average of m pe zea per 
‘ian “quipment was found most frequently in the = Ld gm 
in n hio, Delaware, Connecticut, and Massachusetts. 1w js dens 
1938, Stanton (134), in a survey of 11,169 school teachers throug 
e , 
a pounce, reported that 36.4 percent of the re 
tant facilities, Not satisfied with the representati 
9n s NUES 
that on] ent out a follow-up questionnaire 
Class 
be radios. He concluded, “It is reason 
eplieg ^8 of ownership among the remainder o 
S were a ra 
eed f Elementary and Secondary- 


Sc, UT Vey of memb f the Departments 0: 1 
chool Principals of the NEA, made by Reid (108) in 1939, showed that 


adios we 1 tary schools and in 
6 T rai : t of the elementary s 

A percent Pe ae x Probably the most reliable and com- 
d i LIS Besotidiy Seve S. ]s is the one of Ohio made 


H ens à : f 
In 194 ive survey of radio equipment in schoo! 


by the Evaluation of School Broadcasts staff and reported by Reid 
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(114). Replies were received from 2,348 Ohio schools and data gathered 
so that replies of nonrespondents could be estimated accurately. The surv a 
covered all public schools in the state—rural and urban, elementary S 
secondary, one-room and consolidated. Fifty-five percent of the eU 
reported having radios; 12 percent had central radio sound systems; 
percent had record playing equipment. Other surveys of states have been 
made in Maryland by Barnes (6) and in Iowa by Denger (33). 

Tn the survey of Ohio schools (114), principals reported these uses of 
central sound systems: reception of radio programs for classroom listen- 
ing, broadcasting of administrative announcements, broadcasting of talks 
and speeches, and broadcasting of student dramatizations. In ne 
theses, Haynes (53) and Rudy (125) discussed the school uses made 0 
sound equipment. In another thesis, Young (169) described the pengedar, 
step by step, of installing sound equipment in a school. Probably the bes 
discussions of equipment are the ones by Lowdermilk (74, 75, 77) in 

: which he explained the actual and potential uses of radio sound systems 
Ghd f transcription players, and the report by Hogan and Wilmotte (56) 
dealing prim@ily with the cost of auditory aids in the classroom. 


What's on the Air? 


There are in the United States three types of school broadcasts distin- 

+ guishable by their geographical scope or coverage: (a) broadcasts of the 
radio networks available to schools in most 
(b) programs broadcast over a 


stations to schools in a single state or geographical region; and (c) 
broadcasts originating in individual Cities and intended for classroom 


according to Frost (45), there were 202 licenses granted to educational 
radio stations. Of these 202 licenses, 164 were allowed to expire, were 
transferred, or were revoked so that on January 1, 1937, there were only 
38 broadcasting licenses held by educational institutions. 

There has been comparatively little descriptive and analytical research 
dealing with the school broadcasts of the Columbia Broadcasting System 
stem, and the National Broadcasting Company: 


ve analyses of network school broadcasts 21€ 
those of Reid (107, 109, TIL 139, 116), Robbins (119 


commendations: (a) that responsibility for g 
nationwide school of the air be vested in an educational organizatio? 


rather than in a commercial organization; (b) that the planning of the 
radio series be delegated to specialists in public-school curriculums: 
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(c) that network broadcasts be focused upon broad areas of knowledge 
and cut across traditional subjectmatter boundaries; (d) that broad- 
casts be construed in terms of the unique educational advantages of radio; 
(e) that all individuals responsible for the planning and producing of 
school broadcasts have a knowledge of classroom conditions; (f) that 
printed aids to accompany broadcasts be accurate and specific; and (g) 
that a continuous program of evaluation be carried on during a broad- 
cast series, 

In master’s theses, Hayden (52), McHugh (80), Smith (133), Swine- 
broad (137), Taylor (140), and Wolf (163) gave partial descriptions 
of the broadcasting activities of radio stations, universities, and local 
schoo] systems. In the most extensive survey yet made, Atkinson (3, 4) 
described radio education in 126 American cities. Darrow (29) sketched 
the history of school broadcasts. Darrow (31) also traced the develop- 
ment of the “Ohio School of the Air” which he founded in 1930. The 
story of the “Wisconsin School of the Air” has been told by Bartel j^" 
and in the report of the Wisconsin research project (8). a 


Criteria for Judging School Broadcasts 


„After a year’s experience in listening to school broadcasts, Reid and 
oelfel (117) listed a series of criteria under three general ne 
^ ucational value, clarity and comprehensibility, and interest a De 
& classroom listeners, In evaluating the 1940-1941 series of the gs 
z ton] of the Air,” Reid (107, 112, 116), Robbins (119), and ite 
154) used these criteria. In an appraisal of an NBC series, opem 
iles (101) used similar standards, but in an evaluation of sixty sc al 
"oadcasts submitted in the Fourth Exhibition of Recordings of oa s 
pus Programs, Miles (90) developed four criteria: (a) pis Ft 
of the material to radio presentation, (b) relevance of the mated of the 
®Xperiences of listeners, (c) emphasis upon the social aspects 


Subject bei f ivity by the listeners. 
i urther activity Dy 
n eing treated, and (d) stimulus to cation. prognuné wi 


two studies, one of the Damrosch music apprec: rur ym 
vel other of thirty educational music broadcasts, Wie E Ades us 
( Oped seven criteria specifically applicable to m wo» m 
and used fourteen criteria for judging broadcasts "- p qain 
eleven standards for educational broadcasts intended fo cde 
"d, Tyler, and Woelfel (124) used three ei n = in 
© standards for children’s radio programs: social ideals o! us 

howmanship or entertain: 


E 


Rowla 
pecifi 
d Personality development of the child, and 


quality of the ü . 

DEURES ; he 1940-1941 ‘American 
School” ne basis of teachers appraise S declan at School Broad: 
Casi of the Air” series, members of the 


Pa hool broadcast should 
i p ps b e pw pum y diera it is intended; that 


om 2 : 
the . "Prehensible to listeners in all grade 

aterial be related to the experiences of students; that the content 
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be organized into a simple and coherent structure; that a consistent pattern 
of presentation be followed from week to week; that there be compara- 
tively few scenes, episodes, and characters; that sudden shifts in time 
or place be avoided; that the vocabulary be understandable to classroom 
listeners; that dialect be used seldom or not at all; that sound effects be 
used judiciously and sparingly; that voice fading as a transition technic 
be avoided; that appropriate humorous dialog and situations be used; 
and that the programs be dramatized. 


Kinds of Radio Programs and Their Effectiveness 


Lumley (78) classified radio broadcasts into six categories: (a) radio 
lessons with a radio teacher taking the place of the regular classroom 
teacher; (b) radio talks; (c) recitations or readings; (d) interviews, 
debates, and forums; (e) dramatizations; and (f) musical programs with 
supplementary comments. There is no conclusive evidence concerning the 
lative effectiveness of these methods, although classroom listeners seem 
to prefer dranggtization. Lohmeyer and Ojemann (72) used three types of 
presentation (drama, talk, and discussion) with three types of broadcast 
material (history, science, and literature) and reported that in the ac- 
quisition of information the drama and the talk were superior to the dis- 
cussion, but that in the influence upon attitudes there was no difference 
between the three methods of presentation. Willis (158) found dramatiza- 
tion most effective’ and talk least effective. With a group of twelfth-year 
students, Howell (58) compared a roundtable and a forum presentation; 
i a greater gain in information 
opinion changes recorded in 
the two groups. Using an information test as the criterion, Webster (148) 
found no difference in the effectiveness of a talk and a drama dealing with 


As for the rate of speech, Lumley (78) recommended that broadcasts 
for school children be spoken more slowly than broadcasts for adults (a 
fact sometimes forgotten by educational broadcasters). Cantril and All- 
port (19) found that radio talks are more comprehensible and interesting 


if delivered at relatively low rates of speed, and recommended the fol- 
lowing limits; 


Theoretical material 


ese xe koma 110-130 words per minute 
Factual exposition 


-..120-140 words per minute 


Directions .............. --- 90-115 words per minute 
NERE .og - 120-140 words per minute 
Narrative 


Eaa areas RATE REA e e 120-150 words per minute 


Cantril and Allport (19) also reported that talks should be from ten to 
twenty minutes in length; that specific illustrations aid in the understand- 
ing of an idea; that the use of short sentences helps in the presentation of 
factual material; and that most listeners prefer male announcers to female 
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announcers. Smith (132) i 
th - reported that the speed of delivery depend 
e type of listeners and the length of the broadcast. ig ima 


WI i 
ho Listens to School Broadcasts? 


ee epa answer can be given to this question. In 1938 Frank 
nationwide : al of research, Columbia Broadcasting System, made a 
have Beige te of school listeners to network broadcasts, but the data 
ers of the - in the files of CBS. From a survey in 1940 of 1,160 mem- 
eid (108) a ice gn of Elementary and Secondary-School Principals, 
re a id these data for the “better” schools of the country: 
cent of the Ers used in 38 percent of the elementary schools, in 16 per- 
elementar iam schools; NBC broadcasts used in 34 percent of the 
lusic A dei, in 17 percent of the secondary schools; *Damrosch 
elenen eciation Hour” with the largest audience, 6 percent of the 
even dic Phe and 1 percent of the secondary teachers; all series, 
element intended for high-school students, with larger audiences àn the 
ary than in the secondary schools. 


2» J 
advanced comprehensive survey of all sc 
states in the educational use of radio, Reid (114) reported 


the : 
lius school broadcasts used in 15 percent of Ohio schools, in 
of the cis the rural and 32 percent of the urban schools, in 16 pis 
Percent of the T and 12 percent of the secondary schools, in only ; 
hio scho E one-room schools; CBS broadcasts used in 7 pou 
roadcast, ols, NBC broadcasts in 6 percent, “Ohio School of the al 
x amro d 6 percent, and local broadcasts in 7 percent of Ohio schoo s; 
no e | Music Appreciation Hour” with the la ssroom puse 
stu dee with an audience greater than 2 percent of Ohio s hers 
Se eger all series, even those planned for secondary-school stu ps 
room Ji often in elementary than in secondary-school classrooms; class- 
Stening greatest in urban areas close to radio stations, particularly 


ron, Cleveland, Toledo, and Zanesville. 


@ 
hools of Ohio, one of the most 


rgest cla 


and 


How 
Teachers Use School Broadeasts 


Quest; " 

s i and observation data indicate t 
Course a broadcasts as curriculum material 
accomp study. The teachers’ manuals and classr 
of radio broadcasts seem to be based upon thi: 
Hori, n, P ograms. One interesting exception was i N 
Prepared Series during 1941-1942. Mr. Adamson (1, the scriptwriter, 

Craw. Hi lextbook, Land of New World Neighbors. published by the 
Woelfey ill Book Co., to be used in conjunction with the broadcasts. 
Before e Wiles (162) found that skilled teachers spent some time 

9 broadcast in checking mechanical arrangements, discussing 
*t of the broadcast, and otherwise preparing students for what 
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they were about to hear; that during the broadcast teachers listened as 
members of the audience; that half of the teachers encouraged note-taking; 
that following the broadcast students reviewed the content and discussed 
the production of the program. Reid (110) reported that the teachers 
spent approximately an hour a week in using a series of social studies 
radio programs—eight minutes before the broadcast, thirty minutes listen- 
ing, and twenty minutes following the broadcast. Woelfel and Robbins 
(161) reported that all classes in a junior high school listened each Friday 
to a series of social studies broadcasts, with sufficient time before and after 
the radio program to allow for discussion. Both the teachers and the 
investigators believed that the educational values far outweighed the 
inconveniences of this schoolwide use of radio. 


Experimental Comparisons of Radio and Nonradio Learning 


By,and large, studies of “radio” and “control” groups have been incon- 
Tite, excepf,to show that educational changes can result from radio, 
listening as well as from other classroom procedures. The final report of 
the Wisconsin studies (8:194) stated: “In general the experimental studies 
carried on as a part of this investigation yielded decidedly mixed results. 
The comparisons consistently favored the radio groups only in the field 
of music, and even here several of the differences were not large enough 
to be statistically significant.” In the acquisition of information, Wiles 
(157) reported that a group of junior high-school students learned more 
from listening to a series of news broadcasts than did a comparable group 
of students who studied current events in the classroom. Miles (88) re- 
ported in favor of the radio group. On the other hand, Baker (5), Cook 
(25), and Mueller (91) found no significant differences in the amount 
of information acquired by radio and nonradio pupils, and Loder (71) 


reported results favoring the presentation of material directly rather than 
through a loud speaker. 


With attitudes as with inf 
Davis and Nichols (32) re 


ing eading in influencing pupils’ attitudes 
toward the rights of freedom of speech and of assembly. He found that 
reading was more effective than listening, but that reading the script 
while listening to the recording seemed more valuable than reading alone- 
Of six studies (28, 88, 91, 115, 149, 157) dealing with the effect of school 
broadcasts upon pupil interests, only one showed a significant increase in 
interest concurrent with the radio listening. After careful study of these 
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various “con P 
trolled” studi 
Beo studies, one must conclude tl 
: espe n ude that they add li 
ie sm indt ledge or to educational research. In me e he 
other influential i. formulated precisely, the experimental E d 
lishility of the Istam were not rigidly controlled, the validity sd 3 
Subjects were eiii nr n criteria were not established, the groups p^ 
adequately a isti chnies | 
carefully chosen. q y equated, and the statistical technics were not 


Com ari 
parisons of ( H bv A 1 V. l 
omprehension D ural anc isual Mea: 
p l n by 4 
1 Teans 


Cohe 
n (23) work : 
Men ee worked with several hundred public-school children in 
factual mia and found the results of reading versus listening to ten 
3 S were in :]usiv in (4 i 
as subjects, presented conclusi e. Goldstein (47), using groups of adults 
sented in two ways and at seven rates of speed passages 


Tom th : 
e McCall-Crabbs Standard Test Lessons in Reading. He concluded 


that lis 
1 tening 
g comprehensi ias g ing i 
prehension was greater than reading comprehensio, 


"oldsteiy f 
cially Geet the artificiality of his experimental jtualion, espe- 
a magazine reas | passages projected upon a screen de than from 
Not be assum ^ book. School children, more habituated to reading, can- 
Goldstein, ha ag learn more easily by ear than by eye. One finding of 
is extreme se important implications for educators, namely, that there 
can no more riability in individuals’ listening comprehension. Teachers 
What they h assume that all students listening to a broadcast understand 

ear than they can assume that all students who read a book 


Under, 
Ro What they read 
, nally i : 
Hated "Sheree are Lazarsfeld’s insights (68) 
Scneral, he jaan research studies conducte 
Ney listen te a that the lower the cultural lev: 
the radio; the lower the cultural level of people. the more 


lik 
ely u 

ney d Wi : : { " 
9 Y are to prefer listening to reading; the higher the reading skill 
fer to read than to listen to com- 
e interest in given subjectmatter, 


into the problem, substan- 
d under his direction. In 
el of listeners, the more 


à certai 
; n 
Parable info group. the more they pre 


t : 
hin More sg and the greater th 

Treatment ongly will people prefer the medium which gives the fuller 
s interested people were in current 


For example, the more 
the ire dt preferred newspa 
i ty Tewa erested they were in 

Sus ear” ] papers as their source. 
earning, Lazarsfeld pointe 


t8 that t š 
rib es te ear is more receptive, anot 
i 2 same advantage to the eye- The truth seems to be that the 


iln: 
oe, tha | oed i of perception is of itself of only small importance 
a Municatin nication of ideas; what counts is the situation in which 
the ithe n occurs—the reading and listening habits of the respondent 
racter of the subjectmatter in question” (68, p. 199). 


a source of news, 


even ts the 
preferred 


pers to radio as 
baseball, the more they 
Of the controversy concerning “eye 
d out that “for every study which 


her study can be quoted which at- 
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Transcriptions of Radio Programs 


One of the phenomenal developments in educational materials aanne 
the last few years has been that of records and transcriptions. Commercia 
organizations, the U. S. Office of Education, and radio stations and radio 
networks have released transcribed programs and series of programs for 
classroom consumption. Some of these recorded programs are ten- and 
twelve-inch records which can be played at a speed of 78 rpm (revolutions 
per minute) on any phonograph; others are twelve- and sixteen-inch 
transcriptions which must be played on special machines which turn at a 
speed of 3314 rpm. As Miles (87) has Pointed out, the use of these 
auditory aids is becoming more and more important in American schools. 
Many of the studies mentioned in the preceding section have been made 
with transcriptions of broadcasts rather than "live? broadcasts as the 
experimental stimulus. Recordings available to schools were surveyed 
and appraised by Miles (87, 89). Lowdermilk (76) noted that since 
<kjangeriptions can be played whenever it is most convenient and as many 
times as educationally necessary, they are superior to “live” broadcasts. 
The controversy between “live” and “recorded” broadcasts was investi- 
gated by Wrightstone (164), who found no differences in the learning 
effects upon comparable groups of pupils listening to broadcasts and 
transcriptions of the identical broadcasts. 


Radio Workshops and Pupil Broadcasting 


From the 1941 survey of Ohio schools, Reid (114) reported that 3 per- 
cent of the schools of the state had radio workshops, that most of these 
workshops were in secondary schools, and that there were approximately 
forty students in a group. On the other hand, pupils in 13 percent of Ohio 
Schools took part at one time or another during the year in presenting 
radio programs over local stations—from participating in a band con” 
cert to taking part in an amateur contest. From a survey of eighty-nine 
large Illinois high schools, Purkey (105) reported that half of the schools 
had presented student broadcasts during 1937-38; that the music, speech, 
and English departments were principally responsible for preparing an 
presenting the broadcasts; that the three most 


student broadcasting were (a) giving students experience in radio 
broadcasting, (b) presenting t 


(c) interpreting school policies to the public. Pupils are often used in 
the production of local school broadcasts. Walters (146) described the 


criteria. 


Various aspects of the production and presentation of radio programs 
have been analyzed in master’s theses: newscasts by Edmonson (34), radio 
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plays by B = 3 
tance B en bd (17) and voice training by Hale (50). Of more impor 
and vad arie i in technics, however, are the books on script iris 3 
larly hise is n written by experienced radio broadcasters. Bie ts 
pue Recs Ms McGill (79), and Wylie (168). As for the 
i cessary for radi S Í j S pr 
ist ) o personnel, L n 

he most exhaustive in the à s evenson's investigation (70) 


Radi 
io Courses and Units in Public Schools 


In 194 : 
ies, te ee 15 percent of Ohio schools had radio units or 
of the uniqi o them in the fields of science and mathematics (114). One 
grade a ice developments in radio has been that of the tenth- 
ture, speech. en, of study (121) in Rochester, New York. The litera- 
ocused pail n composition activities of the second-semester course are 
(113) mad radio. With the cooperation of Rochester teachers, Reid 
Perimenta] es evaluation of the course. Stenius (135) described an ex- 
master’s thes urse in radio offered in Detroit Western High Schoel. I» 
Pilities of ų is Blecker (14) and Foltz (44) discussed song of the possi- 
In radio i radio in the classroom. Power (104) described a course 
9 curriculum included in the high-school curriculum of Texas. Of interest 
artlett and ior yo are: an analysis of occupations in radio by 

i iller (11), an investigation of the objectives and content of 


radio s 
e 
ch peech courses by Lawton (67), and an analysis of the training and 
(70). 


aracteriar: 
eristic š A " 
s desirable in radio personnel by Levenson 


Curr; 
rricul 
um 
Use of Out-of-School Broadcasts 
that in 78 percent of 
adio li tion to pupils’ out-of- 
istening, principally through occasional recommendations 
ent of the schools were there 


t to : 
€achers he iar programs. In only 4 perc 
assigned radio listening, thus placing the activity upon an 

hool assigned reading. 


qua] 

„al footi 

Reid (113 v academically with that of out-of-sc 
escribed some of the ways in which Rochester, New York, 


le 
ache 
. CTS ma P 7 
of Interest: de use of evening radio broadcasts. Lowdermilk (76) made 
= Hd . B 
the avn study of the curriculum use of “America’s Town Meeting 


e 
9 * 
= the coun Toadcasts. High-school students in thirty-two classes through- 
y di try listened to the programs at home, then spent the following 


Iseu " 
. JSsIn : s 
io g the issues in class. 


A 1941 
the s survey of Ohio schools (114) indicated 


cho 
ols o 
Choo] y, ne or more teachers gave some atten 


to listen 


dileatorg por am discrimination —Radio has grown so rapidly that. few 
b mination ; seriously considered their onsibilities in developing 
Re radio di n In radio listeners. Tyler (14 e case for teach- 
with sh ee Hee and suggested that it probably belonged in the 
Robp Vatying he possibility of teaching discrimination has been studied, 
ins (gy ne by Merrill (85), Goudy (49); 
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Conclusion 


Such has been the research of the past few years dealing with radio in 
the schools and classrooms of the United States. Despite the mediocre 
quality of some of the studies, despite the insignificance of some of the 
findings, despite the lack of coordination between investigators and between 
investigations, a synthesis of the field permits four generalizations: (a) 
that there are on the air today many broadcasts highly enjoyable and 
educationally valuable to pupils and teachers alike; (b) that compara- 
tively few teachers use this curriculum resource made available through 
technological progress; (c) that radio broadcasts, like motion pictures, 
books, magazines, and other teaching aids, can be used effectively in the 
achievement of educational objectives; and (d) that the possibilities of 
radio—as a medium of communication, as an agency of education, as a form 
of art and literature—have only been touched as yet in the public schools. 
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CHAPTER VII 
The Library in Education 


HELEN L. BUTLER 


Rs 

his tere LIBRARIANSHIP isa recent development. Until perhaps fifteen 
bilosen s apo library investigation consisted largely of enumerative 
DX m m its small-scale service studies of local institutions. Since 
sized raa mit the output has increased from a small trickle to a fair- 
touched by erue by clarity and force. Whole areas still remain un- 
ey di estigation, but where work has been attempted a scientific 

s east has resulted. 


Research ; 

earch in Librarianship: Bibliographies 
ain limited. Waples® (8877 
ry school? of the nation. 
dissertations embodying 


Bibli 5 
Pr “dase of research necessarily rem 
itmer (93) ex of students in the graduate libra 
© work of os the source by drawing off ml 
area to studi both education- and library-school students, but limited the 
er list for r^ of the secondary-school library. Heaps (30) supplemented 
hitty-five aa years 1936-39. Carnovsky (12) restricted his cue to 
ography "va s he considered progress-making and definitive. No bibli- 
Secondary. nown to the present writer which cuts across elementary, 
institution,” college-, and public-library fields, in terms of education. No 
Stractine or agency has yet undertaken the systematic collection or ab- 
8 of published and unpublished studies in the library field. 
Phi 
aliy and Objectives of the Library in Education 
w s 
Service Fw by Wilson (94, 95) called attenti: 
Which EP take in college and university and to the esse! 
Tanscomb for productive relations between students, faculty, 
of meri (10), after a year's study at the request of the As: 
ican Colleges, emphasized educational effectiveness and urged 


that Š À 
i 1 Prarie be encouraged to develop plans in which t 
t erge as an instructional tool of first importance. E] 
eVelopm: secondary level, Ditzion (20, 21) related the origin and 
as Dix et of school libraries to the work and philosophy of such leaders 
Educatio orrey, Mann, and Bernard, and paralleled library progress with 
se mal advancement. In New Jersey (62) librarians from 165 junior 
the i nior high schools recorded their opinions concerning the role of 
(a ed as a school activity. Most important, in the order named, were 
Teadin ching the use of books and libraries, (b) directing pupil leisure 
& (c) assisting instruction, (d) adjusting library service to chang- 
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ntial factors 
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sociation 
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ing class content, and (e) establishing an atmosphere of sear E 
operation. In actual practice they acknowledged the first of these to be aa 
The most succinct expression of the philosophy of the school library he 
found in the brief preliminary statement of the circular issued by the 
American Association of School Administrators in conjunction with the 
Research Division of the NEA (3). Here the library was conceived to be 
at once a service agency, teaching agency, book center, and reading center. 


Evaluation of Library Service 


Early attempts at evaluation by state departments, accrediting bodies, 
and local school authorities resulted, according to Spain (76), in quanti- 
tative measurements of book stock, seating capacity, and other genit 
items, which not only failed in their purpose but eventually ne. 
library growth. In 1936, accordingly, Waples (88) published at the reques 
of the North Central Association his basis for the determination of quali- 

«estive, standards for the college library. He recommended four eg 
(a) an information schedule showing funds, methods, and policies : 
book collection; (b) a checklist of general reference books; (c) a chec j 
list of periodicals; and (d) a reading record for each student and faculty 
member. A year later there began to appear in print some of the prelimi- 
nary findings of the Cooperative Study of Secondary School Standards. 
From these and other data were evolved criteria (16) for evaluating the 
high-school library in terms of the philosophy of the school of which a 
is a part, of the nature of the pupils it serves, and of the community 1? 
which it is set. The rating included eight phases (Schedule F): library 
staff, organization and administration, book stock, magazines and speci? 
materials, book selection policy, teacher and pupil use, service policy, e 
adjustment to the objectives of its own school. This is the fullest and mos 
satisfactory set of criteria yet worked out, and should prove a means O 
estimating not only the relative standing of a given library but also ii 
improvement and growth over a period of years. 


Library Surveys 


Joeckel (35) reported to the Advisory Committee on Education 07 
library service of all lypes including, briefly, public libraries, schoo i 
college, and university libraries, and, more fully, federal library service: 
Many of his deductions were based on conditions cited in Wilson's earlier 
work (92) which had pointed out the percentages of population whic? 
received library service in the states; the small number of counties whic 
had complete public library service, and the lar 
which had none; and the locati 
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descri o 
Pun MM vet seating capacity whatever for their pupils 
E umm i c assification system for their books. 
saes cum ^ eys of school-library conditions have been made in two 
approximately iw ar Le nd ra i schools, California (11) evaluated 
comparisons E — public-school libraries. The data permitted 
The Reseni? 1 e drawn on many points with conditions in other states. 
contribution be us of New York State centered attention chiefly on the 
Carnovsky (Bos F to the reading program of the state. Thus Waples and 
Seiephool sh ound that in two superior communities the quality of 
apritðached enn reading was better than that of their parents and 
had a positive ii i of their teachers; that the library’s educational value 
When schoo] a € ationship to funds available; that the richest returns came 
istributine peri public library cooperate; and that the existing method of 
ound tit ai ate aid to public libraries needed revision. Smith (73) 
elow nation esee te pupils of New York State were somewhat 
conscious b ora knowledge of literature; that teachers weregboqz» 
of the TEN imited in book knowledge and book sourcesipand that some 
er communities most poorly supplied failed to take advantage 


of the 
State traveling library. 


Coo 
erati 
Peration between Library Systems 


the substandard 
and lack of ad- 


A 
conde have been made in some regions to rectify 
rdi nia. from inadequate financial support and eal 
tbraries, p Men by resorting to state aid and state supervision o a 
Collected ermissive and mandatory legislation 1n this respect has been 
Upon gp and analyzed by Lathrop (44). The effects of such supervision 
(100). Hs th and organization have been studied by Gaver (28), Wofford 
Goode (6), and Hoyle (32) for certain southern states; by 
Skaar (72 (15) for Illinois; by Lane (43) for New Jersey; and by 
vesti ) for Wisconsin. . 
Etween ‘gators have deprecated the overlapping of function and service 
Posals į public- and school-library systems and have made various pro- 
s ntended to spread books more widely and with greater economy 
competia, exists. Joeckel (35), for example, called attention to the 

i live aspect of respective services. The Educational Policies Com- 


ission i Cor 
meludi (60) proposed the ultimate unification of all educational activities 
i ity under the public edu- 


n ta eee mal 
Cation a 8 public libraries) within each commun 
Tactug uthority and, until this could be prought about, suggested con- 
| agreements between public and school libraries. Cecil and Heaps 


analy (rates 
Coy nalyzed carefully various participatory schemes of service in state, 
s, and described costs and 


mty, reoi cipator} 
activity regional, and local cooperative units, 1 

h cooperation is in effect. They 
by the schoolboard, 


les i x 
"Commen. sixty-seven cities where suc 2 
“ceo Pani ed full responsibility for library service 1 : 
nied by cooperation with other library agencies at all times. 
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So, too, a Joint Committee of the NEA and the ALA (61), evidently fear- 
ful of the loss which too-sweeping changes in school-library policy might 
entail, was emphatic in its declaration that the place for a school library 
is in the school. From practices reported in thirty-five selected communi- 
ties, the Committee presented a detailed account of the activities and pro- 
cedures which illustrate acceptable working relationships between school 
and public library. School administrators may find help in the compara- 


tive figures published by the American Association of School Adminis- 
trators (3). 


Library Organization and Management 


Research in the field of internal management is progressing rapidly. 
In 1932 Allez (1) made a time-study of the activities of librarians in 
eight Wisconsin teachers colleges, noting the number of hours per weck 
professional and clerical staff members said they spent on administrative, 
Service, and "professional" activities. The 
findings were €ymewhat weakened by the fact that there was little agree: 
ment in definition of terms. Crookston (17) found the direct labor costs 
of services for 542 professional, clerical, and student staff members in 
eleven high-school libraries which ranked high by the standards of the 
Cooperative Study of Secondary School Standards. She computed the 
unit costs of reference, teaching, advisory, circulating, cataloging, an 
other services. The mean cost of acquiring a book in ten libraries was 
found to be 2.6 minutes, or 3] cents; circulating the volume required the 
same time but only 2 cents. Most expensive of the library’s tasks was the 
preparation of a bibliography which took 98 minutes and cost $1.59. 
Other studies in internal management include (a) the formula worke 
book-fund apportionments in Los Angeles 
ge cost per book in high schools, and upon the 
od in the social studies; (b) the cost of acquit 

ge book collection investigated by Miller (55) 1 
(c) the efficiency of separate library rooms versus the study-hall combina 
tion in Louisiana by Robert (69); (d) steps in the organization of ce 
tralized library service for New York rural schools by Rimkus (68) ; and 
(e) comparison of the professional and academic training received 
secondary-school teachers and by librarians by Alstetter (2). 


schools based on the avera 
average use per pupil-peri 
ing and cataloging a colle 


Adequacy of the Book Collection 


mary procedures consist of checking the ae 
ainst subject fields covered, inclusis 
on, and size of classes or enrolmen 
In elementary schools, grade placement also is often considered. Mo* 
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complete in data collected was the Missouri study (101) made for the 
ommittee of the Cooperative Study of Secondary School Standards, which 
obtained figures for the number of titles, of duplicate copies, of social 
Science and natural science works published within ten years, of magazines 
Subscribed for from a recommended and weighted list, and of the sup- 
plementary materials such as slides, films, pamphlets, and records. Cali- 
fornia (11) reported by level of school and size of enrolment the fre- 
quencies of possession of standard reference works, of recommended 
Magazines, of professional books for the librarians? use, of newspaper 
Subscriptions, and the percentage of books in each major classification. 
On the university level, Raney (65) checked some four hundred subject 
ibliographies against the holdings of the University of Chicago libraries 
and formulated his acquisition policy and needs upon the weaknesses id 
Tevealed, Bariani (7) took into consideration not only the € 
according to publication date and subject distribution but ascertained cur- 
Ticulum strength by relating the titles to those in authoritative M 
Piles, to course assienments and needs in her school, and to availa pil 
elsewhere on campus. These studies may be contrasted Wh that o bs 
ibliographical Planning Committee of the University of des is 
proceeding on the conviction that the adequacy of a co 


Which, ee 
; Senet by aries 
est judged by the faculty who use it, inspected the pei sé] 
A Partment by department and shelf by shelf, and found the o 


y 89) who 
ace is also found in the methods employed by i£ es cd 
le uated from various sources a standard juveni B. e pas ho 
studi York normal schools. Martin (53) synthesized she pe a 
one hn of periodicals, consulted widely, and prepared 2 
"ndred selected periodicals for high-school use. 
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Bener] 
“reculat 
Causa] 


ne 
Wa 
So. x 


: eived so much 
bly no phase of the library in Qi s ee to incautious 
n or ranged so widely from scientific wg ne citation of total 
ization as has library use. Reports vary od to factors believed 
i S isi ssign E 
ion figures to detailed distributions £r © ding tie back in 


hildren's rea 


y gslative. Most of the studies n g (19) and demonstrate the 
" 


undr Y or another to Terman’s early study f intelligence, age: and sex 
less of hi s influence 0 Ə 
; is deductions on the in 


ing interests of 
2,93» Yenile reading. Lazar (46). investigating the Coq. num em 
the ew York City pupils, found that the bright 4 „s: and that while 
e 88e or dull; that girls read more books en sls the boys men- 
tion StS who read boys books were usually bright e atel 
MET NE girls? books were dull. Availability of sita pen] schools in an 
Toy, Stressed by Stribley (78) who inspected nineteen po saniye aL US 
tolle county, The appalling conditions brought out id ercent of which 
"ons were reflected in the pupils’ reading, es ited of “Big-Little 

a standard list and 14 percent of which cons - 


Review or EDUCATIONAL RESEARCH Vol. XII, No. à 


Books." A correlation coefficient of --.72 between total books read and 
number of books read from the school library was thought significant 
evidence that the children were reading what was at hand. In 1930 
Lewerenz (47) found that the higher the IQ level of Los Angeles schools, 
the greater the representation among public library users. 

The effect that skilful instruction and a free-reading program may have 
in improving reading habits was demonstrated by La Brant and Heller 
(41), who through individual suggestions and formal class discussion 
were able to extend both the quantity and quality of reading done by two 
groups of students in the Ohio State University School over a period of 
three years. The writers reported marked sex differences. From records 
for 112 pupils, varying from one to six years, in the Bronxville, New York, 
high school, Eberhart (23) concluded that the seventh grade is the period 
of widest reading, but that, although reading in senior high school is less 
voluminous, the proportion of nonfiction read is almost four times as 
miea and the fiction reading is more mature. The negative results obtained 

when guidancg,is lacking are implied in the study by Lawshe (45) who 
found that uh read no more after free reading had been introduced than 
when reading was prescribed; that marked decreases in biography and 
travel had' occurred; and that fiction, some of inferior quality, had in- 
creased. 

The problem of the nonreader has long interested librarians. Linderman 
(48) studied sixty-five nonusers of the high-school library and found that 
they came largely from nonreading homes; they had not been read to or 
otherwise stimulated to read when small children; they belonged to no 
out-of-school clubs and took less interest in the school's extracurriculum 
activities than did their classmates. Though their average IQ was only 
3.4 points lower than the average for the school, 45 percent of this group 
was receiving failing grades. As a partial explanation of differences ob- 
served in reading habits, Moreland (57), Zeller (102), and Thorndike 
(81) attempted to determine basic interest patterns rather than actual 
reading preferences. After examining the responses of 2,891 bright, aver- 
age, and dull pupils to 88 annotated fictitious titles, Thorndike concluded 
that sex is the most important determinant of interest, and that within the 
same sex bright children are most like slow children who are two to three 
years older. His findings should interest teachers and librarians responsible 
for reading-guidance programs. 

Waples and others (86) synthesized the literature on social effects of 
reading and enumerated motives which send people to books, describe 
the values they find in them, and hypothesized the effect that books 
share with personality in modifying social behavior, 

An overview of college and university library use may be obtained from 
the articles by White (90) and Smith (74). Much additional information 
is available in general college surveys and in the report of the evaluation 
study by Waples (88). Many of these are ably summarized by Branscomb 
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(10). Results are not always comparable due to variations in local record- 
‘eeping and in open-shelf policies. Among more recent studies may be 
Cited those by Thompson and Nicholson (80) and by Stieg (77) whose 
findings largely confirm earlier investigations in respect to mean circula- 
tion per student and subject fields most in demand. Engleman (25) re- 
Jected reserved books from her consideration in an attempt to discover 
the responsibility for and success of the general reading program in 
Seventy-nine liberal arts colleges. She showed that general reading, as 
“ontrasted with reserves, had increased slightly over a five-year period; 

at less than one-fourth of the institutions had studied their students’ 
M intensively, and only seven had applied the results to Ea book- 
PE policy. Lancaster (42) found little correspondence etween 

al library use and the amount of instruction given. 


Teaching the Use of Books and Libraries 
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rowed. Unfortunately, the records also include books circulated to stu- 
dents in neighboring schools. Morriss (58), however, limited her observa- 
tions to a small group of adults whose elementary-school education had 
been neglected. She advanced certain book-selection criteria and a short 
list of books meeting these standards. Egan (24) investigated the reading 
of young men enrolled in CCC camps and reported good results from per- 
sonal advisory service. Flexner and Hopkins (26) analyzed the records 
of 1,250 persons, or 20 percent of the total number, who had asked help | 
of the readers’ adviser in the New York Public Library. The purpose, sub- 
jects, and extent of their reading were related to sex, education, age, an 
occupation. General statements of opinion on adult reading are expresse 
in the papers edited by Wilson (93) and in tlie more comprehensive list 
of works compiled by Beals and Brody (8). 


Some Areas for Further Research 


Many gaps in our knowledge of ,the part played by the library in edu 
cation call fof further study. We should like to know more about the ele- 
mentary-school library: what its particular functions and performance 
under optimum conditions are, as distinguished from those of the secon” 
dary-school library; how to evaluate it in its own setting; the efficiency 
of the teacher-librarian in contrast with the full-time librarian, and the 
point of diminishing returns for each. High-school principals and libra 
rians would welcome convincing proof of the effectiveness of the study 
hall combination over the separate library room, and the circumstan¢® 
under which this is true. For libraries of all levels information is neede 
on the relation of library costs to those of other units, that is, subject fields, 
laboratory subjects, gymnasium and health programs, and all spec!? 
curriculum fields. Especially do we need more light on the nonreader, " 
his characteristics and whatever might explain the fact that the student wis 
reads widely tends also to stand high in his classes. For the community a 
large, evidence must be secured of the most satisfactory means of utilizin? 
the library resources of the region economically. n» 

Meanwhile it is interesting to observe that the direction which the admin 
istration of this educational instrument should take is still under questio". 
For many years institutional libraries followed the pattern set by the pub 
library as a more or less independent and self-contained unit. More recent 
School and college libraries have proceeded on the theory that the library 
is not an entity in itself but an integral part of the school it serves. Becau* ; 
many school systems are unable to provide libraries of the caliber now cozi 
sidered essential, educators look to cooperation between all library age 
cies in a community. As has been seen, a few pioneers favor the admin? 
tration of all libraries by the educational authority. The very proposa — 
indicative of the boldness with which current research is challenging lon 
accepted traditions and modes of library procedure. 
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CHAPTER VIII 


Visual Aids in Education 
JAMES S. KINDER 


Ix SPITE OF THE FACT that this is the first systematic presentation of visual 
literature for the REVIEW, it is not possible to do more than sketch in 
briefest form the history of the development of this field. Emphasis 15 
reserved for the more significant researches of the last three years. Visual 
education is one of the most rapidly developing aspects of teaching. The 
lerm is used to identify representational and experiential materials an 

technics, which in one way or another are used in every effective school 
to clarify and intensify the learner's mental images of the object, process: 
or event being studied. Visual aids have been used by classroom teachers 

emas generations; some forms, however, are relatively new. 

The present @eview is too restricted in scope to classify all the researches 
done in this field, because these aids include such media as blackboards: 
bulletin boards; cameras; cartoons; demonstrations; excursions or fiel 
trips; films (silent and sound) ; filmstrips; graphs, charts, and diagrams; 
illustrations; maps and globes; microslides and microphotographs; models, 
specimens, and representations; museum materials; opaque projection; 
slides; and stereographs. In the literature for this field, one finds the terms 
“audio-visual” and “visual-sensory” as often as the term “visual” alone 
To avoid what appears to some educators as a confusion of terms, Holling? 
(33) suggested that the designation “perceptual aids to learning” be sub- 
stituted. Thomas (67) used the same terminology. Hollinger stressed the 
need for emphasis on the meaning, place, and importance of the “percept 


s i is gues, Weber, Sumstine, and others. 
that time research in this field was rare. Today the literature is replete 
with discussion articles, surveys, 


Educational Screen is a journal 
education.” The Visual Review 


5 à ppear in the journals p 
the various state education associations, Textbooks, pamphlets, conferen© 


proceedings, and news letters increase the volume of material. d 
Many school experiences are sterile and barren. Purely vicarious a" 
verbalistic learning of facts is not consistent with modern theories © 
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education, Ey, 
cntomporary af Emily D E hard ers the learner is somewhat like the 
acts but not i] ) ckinson, of whom she wrote, “He I 
ticularly th 1e phosphorescence of learning.” gue all the 
in visual kid AX desi picture, has ouo proci indi par- 
a. motion enr. P previously was rather drab Se ititarentivted 
ag to a n rate have proved to be exceptionally effective 
fares broad: d give vivid and lasting impressions; detailed 
a score of ve sting, and stimulating experiences; and variety. 
ars ago educators were asking, “Why visual aids?" 


o 
day the question is, I 
is ; n i i 
, “How can we use visual aids most effectively ?" 


Te 
chni i 
es in ing Vi 
Using Visual Aids 


Vis 
ual educat; 
1cati i ü 
on is not a subject nor is it a distinct met 


Projeci 
t meth 
od s am 
€monstr. . the socialized recitation, the unit plan, 


hod such as the 
or the lecture- 


ation, It i 
NO T ; S. od A 
a procedure which deals with visual materials. It is, 
as the libraryo a> 


therefore 
dboratory Supplementary to other methods much 
n technics 3 Supplementary All these procedures, 
i ake (40) pon optimum results. 
$ acher before sein that motion picture: 
op Usted to the "d are used in a learning uni 
"A M lips shen of the lesson; there shoul 
eceive the film; before and after the film showing there 


defi. € lime 
mte «4 allowed for related class activity; and there should be a 
jils got from the film. Dick- 


le check-up” 

kia > as Ji of the ideas which the pur n Dic 

Shoy ig 100] level, ame extended experience with visual aids at the junior 

Use an et with Lake, but added that teachers and pupils 

Isted Vac tea of some kind for purpose of future record. 
s, or “don'ts,” for the teacher as follows: (a) showing 


t 
r 
Pup; More u 
a nrelated films during the same period, (b) failing to have 
fi 


howeger, have their 


s should be previewed by the 
t; film ideas should be 


d be specific preparation 


S Ll 
Quest; OW speci 
Ho pecifically the purpose of the film, (c) asking very general 
a film showing. (d) showing the 


film a sufficient number o 
from the teacher's manual 
t sufficiently related to 
ome other aid would 


n ns to 
M at the a the discussion after 
Which readin time, (e) failing to use the 
the i accompa ng extensively to the pupils 
have a under er the film, (g) using films no 
nie ‘et y, and (h) using a film when $ 
oj AUG es controlled experiment with eight hun 
the i Esome ience students, Krasker (39) got at the heart of many 
arning Problems of film usage. He found that size of class affects 
the p Were deg though films are used. (Small classes—exact size not 
etter than large classes. Doubtless, much of this was due to 


tig, Oct th 

n at 

fo better learning attitudes prevail in smaller classes.) Prepara- 
ses should not be marched off 


to s 
t owi 
M Pu denis the film is essential. Clas 
ed muc ie for the film showing. The Michigan yearbook (48) 
e same points. 
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No instance of scientific research has come to the present reviewer $ 
attention which has shown a loss in amount of learning by pupils Ee 
taught through the use of visual media. Stadtlander (66), Hansen ee 
Kirkpatrick (38), Wise (76), Lamoreaux (41), Krasker (39), Bra 4 
(10), Reitze (57), and others showed definitely that visual aids Pe 
distinct asset to effective teaching. Also, researches show that this sta 1 
ment holds for all, or practically all, curriculum subjects. A few ES 
sentative studies here are: in English—Ginsburg (23), Spilde (65), Hol 
land and Netterville (32), Hart (27); in nature study and geography 
Stadtlander (66), Peters (53), Repass (58), McLeese (45); in ee 
and social studies—Wise (76), Eichel (21), Walters and Noel ai 
Bradley (10); in reading—Winchell (74) emphasized the value e if 
flashmeter and other types of visual aids, and Berg (8) achieved excel “a 
results with retarded readers with the use of the filmstrip; in science 
McCowen (44), Maneval (46), Molyneaux (50), Bennett (7). 


e 
Other Uses af Visual Aids 


Most of the foregoing studies dealt with factual learning of the er 
room type. Ramseyer (54) investigated the effect of the doanean ^ 
film on social attitudes. Using students from the sixth grade through col Ae 
and noncollege adults, he showed changed attitudes produced by -— 
pictures. Social awareness can be materially stepped-up. Furthermor^ 
the changes wrought prevail after a period of two months. at 

Appreciation—Educators and critics have been concerned over w 
appears to be a low caste motion picture appreciation, Efforts are D? 
being made in the schools to cultivate a high type of appreciation n " 
body of critical-minded theater-goers. Dale's work (15) has been significa” 
in this area. Scores of classroom teachers and principals, among y" 
Williams (72), Allensworth (2), and Smith (63), have produced 2 


. 5 ar! 
results. Motion picture and photoplay appreciation clubs and classes 
numerous. 


Picture production—Recentl 
and motion pictures. In some 
type designed to impress the p 2. de 
In other cases, however, the making of films has a real purpose. It stim j 
lates creative pupil activity and creates worthwhile learning situatio” 


c 
to school-made films. Livermon (42) showed conclusively that m" 


originality in acting, writing, designing, and directing is provided 
school-produced films. ple 
Public relations—Administrators see in visual aids not only valu? Ji 


educational tools but also implements for the cultivation of better pU 
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relations. : . 
budgets, o s effective way of *selling" the school, or ever i i 
modern, dienifi Dies pn Martin (47) feels that the motio "renis 
school js i = impressive way of letting the public eet e the 
made film ee i agner (70) made a careful survey study of To ^ 3 n 
Used such a m hs relations in Ohio. Thirty-eight districts in Do laf 
football, safety s ure, filming such topics as a typical day in the school, 
Service, He dli d Day, teacher selection, community aspects, and publis 
Power than oth ved that the school-made film has more audience drawing 
attendance at and school-community meetings. Some schools reported that 
reactions of ie l meetings in their districts had doubled. Comments and 
concluded that . school patrons were highly complimentary, hence Wagner 
at school-made films “should be a part of every balanced and. 


Contir 
nuous i i 
public relations program." 


Equipm ent 


Numerou 
il now a articles dealing with equipment or surveying thee a= 
“nt reference ] in schools have appeared from time to the. One signifi- 
lotion Pictur En appeared over the last three years. The Society of 
on-Theatrical E ngineers in 1941 published a report of its Committee on 
al Equipment (64) , which is a most reliable and usable study. 


le Saa: 
OClety 
efin; y gave : s É a p B 
ning d i pertinent suggestions concerning technical specifications, 
i ance of 16-mm. projectors, and the typical characteristics 


Vari 
ou; y 
S types of screens. 


School Journey 


School ; 
TPertoire, Tn the excursions, or field txips are 
p ennsyly, the last decade they seem to hav 
terially to urs State Department of Public Instruc 
Proyig 3 A bulle development through the publication o 
o vided furthe etin of the elementary principals of Los 
to bia a Mops The trips of Lincoln School, Teac : 
eval € coal ddr a have been given much publicity. One of these trips 
hie} ion and s of West Virginia) was deseribed by Baker (5) and an 
“school ppal made by Raths (55). About a year me 
stud ew York. oe of Morgantown, West Virginie, mace a 

eXperience: s (36) provided an excellent evaluation O°. 
Stud nts. One "i showing changes in thought-pattern of the in ividual 
o ents on igh-school principal (59) apparently takes his high-school 
fay Sand mile ten- to twelve-day junket each year covering some three 
trip Istant Fee or so. This principal is also looking forward toa not too 
Cone, elke npe: his school will offer credit toward graduation for field 
has not only emphasized the values 9 


e teacher's 
e taken on new meaning. 
tion contributed 
f two pamphlets 
Angeles (43) 
hers College, 


old technics in th 


t 


er f trips but has given 
he most 


rej; th t à 
liable © the standards for judging field trips. T pretentious an 
de by Atyeo (4) 


Stud ; 
Y yet reported in this area Was ma 
339 


Review or EDUCATIONAL RESEARCH Vol. XII, No. 3 


Other Visual Media 


Although the motion Picture is the predominant aid in the visual field, 
each of the other aids has a specific part to play. No one tool will serve all 
the educational purposes served by visual education as a whole. Each aid 
has a more or less specific function. Slides and motion pictures are ex 
ceedingly valuable in teaching geography, but Waddle (69) also found 
the stereograph to be a useful tool in geography teaching, j 

Science teachers have achieved excellent results with the microscopic 
projection and microphotographic slide. For purposes of projecting live 
specimens and bringing interest and reality to the class, these media can 
scarcely be equalled (73). Breechbill (11), using controlled groups in an 
elaborate experiment at the University of Maryland, found that experi- 
mental groups of science students taught by use of microprojectors showe 


for each pupil. Other results were: in general the pupils seem to prefer 
nficroprojector method; beginning students appear to profit more than 


advanced stud@its. The results of such an experiment should mean con 


three basic types of illustrations—diagrams, cartoons, and photographs. 
He concluded that (a) age makes considerable difference in the preferences 
(b) high-school seniors prefer diagrams, (c) ninth- and tenth-graders 
prefer cartoons, and (d) photographs are low in the preference of à 

groups. Somewhat along this same line, researches in recent years hav? 
shown that maps, graphs, and charts as well as pictures need to be taught: 

Carthew (13) emphasized teaching such timely maps as are found i? 
newspapers, magazines, almanacs, and the automobile road map. Cobb 
(14) showed how these are to be used. Wise (75), using controlled technics: 
showed that, with sixth-graders at least, special training in map reading 
and study gave greater improvement than incidental methods, and Wright 
stone (77) found a gradual growth in map and graph reading ability fro™ 
the seventh through the twelfth grades. 

Abramson (1), Berg (8), and Earley (20) reminded us that the opaque 
projector, the filmstrip, and the museum still have their contributions t° 
make. Miller (49) has substantiated the findings of earlier investigator? 
in the matter of what children see or do not see in a picture. Children see 
to miss many items in nearly every picture, and frequently the items aT? 
seen in isolation rather than as Parts of a unified whole. 

One of the intriguing facts that has grown 
is that most visual aids can be used oy, 
placements than verbal materials. Using a sound motion picture, Sherma" 
(62) showed that even first-grade children, some of whom had not pre 
viously seen a squirrel, learned the concepts of gnawing, balancing, TU?” 
ning, climbing, and sniffing the air better than through any other medium 
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Rummel (60), using 2,100 children, Grades III through XII, concluded 


that films hav. g 2, 
s have a larger grade area than has been supposed. Stadtlander 


came to the same conclusion. 


Next Steps 


in a foregoing review is representative of the research and literature 
1) found "panan, The field has grown rapidly in recent years. Kinder 
Institution that research is being carried on in nearly all the leading 
of these es at higher learning in some aspect of visual education. Many 
Bl mara searches are being done in connection with the master s cre 
evenly cigs moră doctoral work is in evidence. Research divides me y 
Tesearc] je administrative and technic problems. Certainly the need for 
2! Into unit studies and grade level adaptations has not progressed 


ar, L e pta i 
ikewise, such areas as artistic and esthetic judgments, attitudes, mad 
ean 


Carnj 
(6) het, processes await much fuller treatment and development. 
eñeves that we are on the verge of new and important development 


;ansen (26) and Reed (56) have outlined a fruitful fiel@for investiga- 


lion 
Some It should also be pointed out that there are many studies, perhaps 
: 9f them of restricted range, which need to be done by the teachers 


In ( e 
"à classroom, These studies, though small in themselves, build the 


n. H . 
the le of knowledge for the use of visual aids. This is as necessary as 
Scr foundation studies. 
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CHAPTER IX 
Educational Psychology 


WILLIAM CLARK TROW 


Das. THE PAST THREE YEARS investigations in the field of educational 
and elg sd were reported under various headings in issues of the Review 
ceptional. di leacher personnel, pupil personnel, mental hygiene, ex- 
eing th ildren (35) —perhaps the most significant work in this area 
hos ne delineation of endogenous and exogenous feeble-mindedness by 
e and Werner (84) —growth and development (61), and intelligence 
Utter During this period the IQ controversy (94) ran tampani with a 
the cou "iin ora banderillas in its neck defying anyone to à — 
in the i «e grace until the public realized it was witnessing not a strugg e 
wise à rena but a tempest in a teacup. Surveys in the REVIEW tant EE 
ogia Ce or will appear shortly, on appraisal and a$ the pel 
een "Me ars of the school subjects, where the most prolific wor : has 
Ogica] _ reading (96), though the increase was noteworthy in psc 5s 
Music ao; me in the esthetic aspects of learning, er. ré 
Significa ) and in design (100). In this chapter some i^ ae 
those A oe studies in educational psychology are = ah a Pr 
cated ah ne June 1939 issue of the REVIEW, but excluding ps = Lat 
i ove. Hence the material treated will relate to the whole s 


luati 
lo a iH 
n rather than to specific school subjects or activ ities. 


he 
Thought Processes 

TM :orists! cal 
tensi Moning, which came as an answer to the behaviorist sube be 
* More” as been shown by Hilgard and Marquis oom in origi- 

i complex process than the classical Russian exper configurations 
Sug, ot Ded. Responses conditioned by different percept ser ee af 
Stim u estalt organization (71) and raise the Pap" n (39) 

Su j Patterns (72) that is discussed at length by ue reported by 

a " E bus 

Tata m of transfer during the preceding six years Pre familiar ex- 
Plana who discounts “identity” and favors wats f experience.” 

E Tere. “ struction of eX 
Phrases, “generalization” and the “recon 


d lla (90) hich “emphasized 
e " . i wi " 

* di Beneralizati thod in arithmetic 3 i B 
discover tion metl existing among addition combi 


na F4 . 
pation D d us use of rop pe spe ey which each com- 
i 'ed mor ive than a dri . 
Was “a s "1 effective -ith no relation to any of the other num 
cts.” T specific element with ie To generalization 
tag he various interpretations that 67. e given ifs value, since 
~- "Onveni . principle; bu D 
on soe dees at Aas $ yaters of the dart-throwing 
“time pesi s L Sn po to repeat the experi- 
t is now called into question. An effort to rep n 


T [ 
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ment (33) eventuated in results somewhat less favorable to generalized 
experience, as such, than those credited to the original reports. Katong 
(47) emphasized the importance of understanding as contrasted with un 
comprehending drill, memorizing, and training, and Brownell (17) shows 
that the use of a visual “crutch” in subtraction not only did not pr 
to be a handicap but facilitated the learning of both bright and slow Pu ] 

The concept of set is apparently due for a revival since Dashiel a E. 
attenlion to it as a neglected fourth dimension in psychology. s. 
is variously defined and often ambiguously used (29), it turns "P ie 
configural conditioning experiments (70), and in investigations of Ke 
law of effect, in one of which (99) the effect did not operale ien a 
“learning motive” was not present, in an experiment that was disguise 
one in extra-sensory perception, hen 

In one learning study (48) the value of supervision was tested W A 
teacher effectiveness was equated on the basis of pupil performance E 
eliable differences were found in subsequent pupil improvement E 
favor of a sypervised over an unsupervised group. In another (73); ile 
dangers of Miaraized testing were pointed out when high-school pop 
after a six weeks’ introduction to chemistry and twenty days of intens! 
drill on factual material, scored better on the cooperative test than p 
who had spent a year on the subject. A series of studies by Rubin-Rabr 
(75), in the psychology of memorizing piano music, found little di E. 
ence in the effectiveness of different methods except for the appo 
value of prestudy periods. Stroud (85) reviewed the literature on lead 
in school situations emphasizing those studies which test out the res a 
of laboratory investigations. The theoretical contribution of the year W 
Hull’s “mathematico-deductive study of rote learning” (40). 

Razran (69) concluded that verbal conditioning is primarily sema ng 
that is, that verbal stimuli can be equivalent because of their mean! m 7 
content factor. Maier (59) postulated three psychological processes 10 
count for the various ways in which problems are solved: variability: f 
trial-and-error; equivalence reactions including transfer of training: ^, 
that form of concept formation in which some limited aspect of a 9° y 


nti 


Influence of the Social Environment 


While hereditary influences have a determining influence as § 
by studies of identical twins reared apart and of foster children * 
the structure of the social environment is recognized as of treme 
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Significance in th I 
eld o E the modification of : i 
Pen tial psychology (46), bpr kg 
original work eis understanding of its data and on Lid 
Has been emplosigy er de en is that being done by Twin (52) ps 
y ofan. E dr gy asa geometry to repres vi 
lowing thé pones facts having the character m F i 
€ effects of a wai Lippitt (55), using two children's clubs in ich 
srentiated, thing — and democratic leadership methods were dit 
familiar in the ior to clarify many socio-psychological phenomena 
iot confuse inte ee That experimentally-minded teachers may 
arecient ilies n petulant domination and democracy with 
lassroom practice ; Pistor (67) has designed a rating blank listing 120 
s that can be used to aid in preparing pupils to par- 


lici 
pate i 
Ir 
a democratic society 


le meth 
ey affect a eiue and problems of 
"der the aes but the wider society as well, have been summariz 
ampling eU of several leading workers in the $ Jd (10). The 
rly for Te d was effectively employed by Arrington (7), par- 
study of continuities in children’s verbal behavior. 


© wide 
T soci ‘ 
ial environment has begun to attract the attention of 
dious volume (92) 


educar; 
ation 
a al psy : 

2 Other oo. E. L. Thorndike’s compen 
E Process in sg 91, 93) emphasize the continuity of the adjust- 
lal order is į which the school participates. How important the human 
in determining the course © ggested by 
104) in which it is 


Wa 
Y of 
ab; contrast j 
ae » fees in the reports on feral children ( 
i jectives sought and means chosen for obtaining the desired 
of education in Fascist Germany 


s 
(38) ct in di 
fferent cultures. The duty 
itler's soldier raises youth to 
intoxicating con- 


sux dw tg 
“brsindivideal adolescent ecstasy; to be H 
Tor Sts, report on and action and suprahuman, ‘ 
9uth Stud 7) of a comparison of the work of the Bremen Institute 
y for 1926-28 and 1939-40 reveals that as 2 result of the 

er, the later fourteen-year- 


appli 

NAR 

olq Cation of prince’ 
nciples received from the Führ 

racters are firmer, they need 


Stri Broup ; 
rw AA d physically, their cha 
Sirah E usi, e, but their scholastic show not so good. 
but, © culture t of several studies, Furfey (28) pointed out that unde- 
Sings -E area m are not changed by attention to the individual alone, 
hilq 5 of Class, or group. Koshuk (50) reviewed 525 studies, made 
th, "91, indi socio-cultural influences affecting the behavior of young 
ing *esults of cating research trends; and J. E. Anderson (5) classified 
ene, ial bel typical studies and enumerated the chief factors condition- 
Part; Provided pp 7 for example. selective 5o al experi- 
ag de Ration, T the environment, equipment, ; 
Scribed h e teacher's record of socialization WI 
Y Greenhow (31) is not an enviable one. 
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cial learning. soci 
and out-of-school social 
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The school population is definitel 


y influenced by the wider society and 
also by the home environment (57 


); and more effective procedures can 
be employed (30) in modifying the personality characteristics of pease 
by means of a home-training program. But it is within the school soma 
that the widest opportunities are found for improving the social ea 
program of the younger generation. The world did not have to wait a 
Miller and Dollard’s ingenious experiments with rats (60) to learn tha 


children imitate, Apparently those teachers who have a high degree of 
person-to-person interaction 
rated high as instructors (16). 
specific, approving, and unhurrie f 
superior to those of the negative type for young children. The results E. 
studies of the influence of such, however, are equivoca 
(42, 98) since so many other influential factors are operating. More 
specific studies of group interaction can well be made, such for example 
Eg that by H. H. Anderson (3) of dominative and integrative behavior- 
Evaluation—A distinctive 


: ional 
feature of recent developments in educationa 
psychology isthe evolution of 


measurement into evaluation programs: 
After Surveying 129 titles, Orata (63) concluded that evaluation still has 
a long way to g0 before it can full 

school practices. Yet it is these 


generally equal E 
and social performant 
F : : g behind in certain scho? 
mainly arithmetic and spelli Survey of the research finding? 
(68) of the last twenty-five yea ssive education reports no los? 
in academic Proficiency and gain j ms of personal and social a 
"ere reported from a restrict 
aeu group of students falownik d 
gh sc j vi Me 

group taking the traditional required subjen n Put fat 
esults of the E 


E ight-Year Study Sponsored by the 
ssociation (1). 


Írom the presen 


8e performance of 4 


ose who remained bebi” r 
of adult morale as well, 
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which a penetrating analysis by Allport and others (2) based on ia study 
of ninety life histories of the Nazi revolution should prove enlightening. 


Personality 


Studies of various aspects of personality are many and often related to 
educational problems. Schettler (78) listed topical summaries of 308 items 
m, Personality traits. The recurring problem of what the personality bo 

asure was discussed by Bernreuter (12), who recommended that refer- 
A made to Buros's Mental Measurements Yearbook, while ii m 

viewed the research on the Bernreuter Personality Inventory. Brogden 
ii Tan a factor analysis of forty character tests and dunes Speri 
- 5 G and W, honesty, persistence, self-control, and poet, a de 
ee code. With a revision of the A-S reaction study or man Aw 
tie a results were reported: negligible reper rp à Rer > 
ance nd .35 between submission and introversion, p spe m o 
with and persistence, Projective methods (27, 88) are g as ed 

the gradual secularization of psychoanalytic appro? 


io motion of the Rorschach technic (49). Pearson (66) called attention 


tive pro- 
n telected aspect of experience, that of the effect of opera p 


cedures 9n the emotional li i 
i al life of the child. " d other 
inse latins employing the Allport Vernon iir of roe), eenei 
on xiu of evaluative attitude were reported by Dully tiewed by Briggs 
ün a. they refer to as emotionalized attitudes were, xe what they con- 
Sides s es (13) who made their selection on ie rie A novel attempt 
by d Would be of most interest and value to teac m Dexter (22) to 
tae USC of a modified Likert technic was made , rather striking 
di Sinis Changes in attitude produced by speakers; a ost-menarcheal 
Bir], ences in maturity of attitudes and interests of pre- and p 


nd by Stone 
oft : ial status were fow à 
an ne same chronological age and ah p peste, cue 


ark E 
nt er (82). Probably the most in : tors; the 
"st is Being made by Sherakov (81) amd M CP inventory 
has p interest questionnaires as a disguised form of Pd a Super (86) 
9ssibilits " ^t Pyvidence was d A 
tog üp bilities of great significance. spon sations of dominant inter- 
sts 4 Port the view that avocations are man! p^ o" he regular xocation 
i [2 iz) 
Proy; at do not fi d ex :on in vocations. When g h the avoca- 
v nd expression 1n with the a 
tion § S the needed tetany there is no competition 
or S eR a MANOS S. 
an individual's interests and energies: 


“havior Y 
A 

nu 
One ha of phenomena of human P 
pt as received considerable atter 


[n 
ta, 
of nk 


i ignificance 
ariables of Educational Signific wu 
onality have been investigated. 
: - 
gem derives from pod MS 
: s hr 
i hich have been ma 
? Bh: i sno. studies of. Wie ped 
(26), 1 l of aspiration, 20) that a knowledge of pe um 
Se ela M firsthand experience wil 


oth 
i Broups influences the level before ini 
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cessfully to the social norm (80). 


| 
‘menta! 
s xxperim 
phenomena have likewise begun to attract exp 


with | 
he Yale psychologists (23) linked d in 
m they have since relaxed somewhat, P Anthro" 
llent analysis by Britt and Janus (14). ry sp? 
al of the bottle, puzzle boxes, memo obser” 
eans have been employed to obtain na stop 
> chiefly in children. While the phe 
short of the experimentally induced neuroses in rats and other P schoo 
i rongly resemble problem behavior s cenioU? 
Significance for teaching. The most sociae 
Studies are those of Lewin and his utocrat 
especiall ion-ageression series produced under iud i 
Social climates (53), and gression in constructiveness pro 


received, S 
indictment 


s of antique science. 
sensory-motor sphere, clumsi 
(65), and in the area of 
Tramer (11). 


In the genera] 


eat 


a 
2 garte 
social relationships, gratitude by Baumg 


«tele 
Y means of an 17 


c 
The nature of status is coming to acquire greater Significance as a pt 
tical and theoretica] problem. Writing f. i 2 
(103) defined it as the average intensity of the attity es expressed tow ; 
his associates, and cited evidenc Show that it can P^ 
controlled. Lippitt (56) approached the question by studY 
Y. using the method of paired comparisons and observi”? 
tions, and found that children’s and teachers? estimates We" 
based on di erent criteria, the teachers’, for example, being related 
pation. What Dudycha (24) called “depen ability,” which 


social partici 
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consisted į E 

ed in 

E rompt T T 

co P ptness o i i i 

ming to a ight-olclack s SE students in meeting appointments, 
h ock class handing in assignments, and returning 


books to the li s, 
traits or, feet AUN pa found to have no relationship to Bernreuter 
ersistence 5 i ene dependability, to college grades. 
` with Sd ael 4 um (95) found to correlate lower than the usual 
spurious, = achievement and he contended that the higher figure 
- reement of MÀ (19) demonstrated with preschool children a rein- 
stimulation, Thes s re after satiation in a pegboard task through social 
huge different e ep and many others are related to leadership, 
Sinn Hunter sad Jo ities are necessary for leadership in different situa- 
„Control group a (41) compared eighty-two college leaders with 
Sher in ed found them to be lighter in weight, younger, and 
E 1$ doubtful E scholarship, and interest maturity, and so forth. 
; however, if these differences, though statistically reliable, 


© as signi 
ifica 
Snificant as others that their technic did not reveal. 
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CHAPTER VIII 


Visual Aids in Education 


JAMES S. KINDER 
ly SPITE OF THE FACT that t 


literature for the Review, it is not 
briefest form the history of 
Teserved for the mor 
education is one 


isual 
; : visua 
his is the first Systematic presentation of 


m 
possible to do more than wein is 
the development of this field. Emp po 
e significant researches of the last three years. » The 
of the most rapidly developing aspects of teaching. 


vals an 
: : P . : B rials s 
term is used to identify representational and experiential materia 
technics, which in one way 


o 
or another are used in every effective ~~ 
to clarify and j i ages of the object, pr hers 
ave been used by classroom teac 
T, are relatively new. rches 
in scope to classify all the resea em 
include such media as nr 
5 cartoons; demonstrations; excursions | er ms} 
Ims (silent and sound) ; filmstrips; graphs, charts, and diagra 


: ec ; models» 
10n5; maps and globes; microslides anq microphotographs; me 
nd representations; 


museum materials; opaque projection? 
slides; and Stereographs, In the literature fo 
“audio-visual” and “visual-sensory” 
appears to some educ, 
(33) Suggested that the designation « : 
stituted. Thomas (67) usc] na E Perceptua] aids to le. 
need for emphasis 
in all learning. 


Two decades 


The present eevi 
one in this fi 
bulletin board 
trips; fi 
illustrat 


arning" be ye 
a he 
logy. Hollinger stressed et 
place, and importance of the “percep 


T he 
d ago research Mm visual education centered around a 
studies of Freeman and his Colleagues, Weber 
that time research 


With discussion arti 
Educational Screen is a journal “devoted exclusi 
education.” The Vi a 


> 9umstine, and others. 
Was rare. Today the literature is replete 
i l researches. The 
the visual ER 
T nere 
development. Scholastic” T B eekly 
chools, devotes One section t audisisuà 
ournal of Educational Sociolog and Edw 
es each year exclusively o this ony Prac- 
A o 
articles appear LÍ : obe : 
> Pamph], 


et: € 
he volume of i ial Conferenc 


materi 
and barren, Pu i 


nsistent with mo de, carious and 
eories of 
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education, nee 
tne ree i of hard study the learner is somewhat like the 
acts but not the mily Dickinson, of whom she wrote, “He has all the 
ticularly the baa qe nique of learning." The motion picture, par- 
In Visual aids den motion picture, has brought a resurgence of interest 
motion m ield that previously was rather drab and undifferentiated. 
adjuncts to seis and the radio have proved to be exceptionally effective 
aching. They give vivid and lasting impressions; detailed 


Conc 

epts; b 

H 3 broad, i B : e 

al » interesting, and stimulating experiences; and variety. 
9» 


a scor 
e of y " 
oday the sebo er ago educators were asking, “Why visual aids? 
n ; i ‘ t i 
is, *How can we use visual aids most effectively ?” 


echnies ; 

cs i 

x in Using Visual Aids 
Isual 


roj T 
Project y a distinct method such as the 


education i 
ation is not a subject nor is it 
or the lecture- 


nethod. his 

thectstration is socialized recitation, the unit plan. 

frefore, sup J is a procedure which deals with visual materials. It is, 
plementary to other methods much as the library amem 


abor 
atory 
are 
supplementary. All these procedures, howeger, have their 


n techni 
nics i 
ak for optimum results. 


e s 
teacher pao) Maintained that motion pictures shoul 
sted to E they are used in a learning unit; film ideas should be 
6 class ta purpose of the lesson; there should be specific preparation 
receive the film; before and after the film showing there 


shoulg 
© time allowed for related class activity; and there should bea 
n the film. Dick- 


definit « 
EUM 
n ( beue of the ideas which the pupils got from Dic 
ag schoo] a aem of extended experience with visual aids at the junior 
D; üse ar eh agreed with Lake, but added that teachers and pupils 
t Ickter lists a evaluation form of some kind for purpose of future record. 
Wo or m Sted errors, or **don'ts," for the teacher as follows: (a) showing 
Pupils rn unrelated films during the same period, (b) failing to have 
Westion M specifically the purpose of the film, (c) asking very general 
Ee " to start the discussion after a film showing, (d) showing the 
he wrong time, (e) failing to use the film a sufficient number of 
Which reading extensively to the pupils from the teacher's manual 
i'n accompanies the film. (g) using films not sufficiently related to 
ha, wt under study, and (h) using à film when some other aid would 


V 
à Served better. xit handred 
i ii controlled experiment with eight hundred eighth and 


- ade scienee students Krasker (39) got at the heart of many 
th Uublesome problems of film usage- He found that size of class affects 
st h films are used. (Small classes—exact size not 
ried large classes- Doubtless, much of this was due to 
x © fhet that Better learning attitudes prevail in smaller classes.) Prepara- 
lon for showing the film is essential. Classes should not be marched off 
* the dtor ‘or the film showing. The Michigan yearbook (48) 
tressed much the same points: 
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si ver's 
No instance of scientific research has come to the present Sls adit 
attention which has shown a loss in amount of learning by dae (28); 
taught through the use of visual media. Stadtlander (66), m cbe 
Kirkpatrick (38), Wise (76), Lamoreaux (41), Krasker i Ts PES 
(10), Reitze (57), and others showed definitely that visua v: de 
distinct asset to effective teaching. Also, researches show that. this -— 
ment holds for all, or practically all, curriculum subjects. A fewr trol 
sentative studies here are: in English—Ginsburg (23), Spilde Lie 
land and Netterville (32), Hart (27); in nature study and pap iot 
Stadtlander (66), Peters (53), Repass (58), McLeese (45); a m 
and social studies— Wise (76), Eichel (21), Walters and Noe ee 
Bradley (10); in reading— Winchell (74) emphasized the value Sot 
flashmeter and other types of visual aids, and Berg (8) achieved exch E 
results with retarded readers with the use of the filmstrip; in science 
McCowen (44), Maneval (46), Molyneaux (50), Bennett (T. 


Other Uses 6f Visual Aids 


g studies dealt wi 
4) investigated 
sing studen 
he showed c 


th factual learning of the ben. 
the effect of the Lace 
ts from the sixth grade through co Foe 
hanged attitudes produced by a 

ally stepped-up. Furthermo 
ght prevai iod of two months, 


MEN 
goers. Dale's work (15) has been significa 
of classroom teachers 


and principals, among the 

2), llensworth (2), and Smit 

results. Motion Picture and photoplay appr 

numerous, Be 

Picture Production Recent], many sch 
and motion pictures, | 


to school-made fi 
originality in acting, Writing, 
school-produced films. 


Safety rules must 
enver schools made a notable contribution 
9n (42) showed conclusively that muc 
designing, and directing is Provided bY 
Public relations—Administrators see in visual aids not on] ple 
educational tools but also implements for the cultivation of better public 
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relati ^ 

ier = effective way of “selling” the school, or ever increasing 
modern, dignif ap Martin (47) feels that the motion picture is a 
school is tan, pad impressive way of letting the public know what the 
made film Pad i dos ( 10) made a careful survey study of the school- 
Used such a L u = relations in Ohio. Thirty-eight districts in Ohio had 
football, saf ager ure, filming such topics as a typical day in the school, 
service, He a May Day, teacher selection. community aspects, and public 
Power than spe that the school-made film has more audience drawing 
attendance at aa meetings. Some schools reported that 
Teactions of th ic p meetings in their districts had doubled. Comments and 
concluded ds : hool patrons were highly complimentary, hence Wagner 
Continuous p, school-made films should be a part of every balanced and 

s public relations program." 


Equipment 


Numer i 

Peg "y articles dealing with equipment or surveying thee qi 
Sint referen ay in schools have appeared from time to te. One signifi- 
Otion |" pia En appeared over the last three years. The Society of 
on-Theatrical Engineers in 1941 published a report of its Committee on 
al Equipment (64), which is a most reliable and usable study. 


e . 
Oclety ca : a f; 5 s B 
ty gave pertinent suggestions concerning technical specifications, 


efini 
ne 

ber . : age 
8 performance of 16-mm. projectors, and the typical characteristics 


0 
vari 
o 
us types of screens. 


S 
chool Journey 


Se 5 
boe journeys, excursions, or field tsips are old technics in the teacher’s 
" PEL In the last decade they seem to have taken on new meaning. 
ein te State Department of Public. Instruction contributed 
51, 52) to their development through the publication of two pamphlets 
Provided £^ bulletin of the elementary principals of Los Angeles (43) 
olimi: urther emphasis. The trips of Lincoln School, Teachers College, 
to th ia University, have been given much publicity. One of these trips 
eva © coal fields of West Virginia) was described by Baker (5) and an 
i pei and appraisal made by Raths (55). About a year later, thirteen 
fa enn! students of Morgantown, West Virginia, made a ten-day trip 
Vo SEN York. Jones (36) provided an excellent evaluation of this field- 
ed experience, showing changes in thought-pattern of the individual 
a ents. One high-school principal (59) apparently takes his high-school 
Udents on a ten- to twelve-day junket each year covering some three 
lhousand miles or so. This principal is also looking forward to a not too 
àr distant day when his ll offer credit toward graduation for field 
trips. Selke (61) has not only emphasized the values of trips but has given 
Concern to the standards for judging field trips. The most pretentious and 


reliable study yet reported in this area was made by Atyeo (4). 


m 
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Other Visual Media 


Although the motion picture is the predominant aid in the visual £d 
each of the other aids has a specific part to play. No one tool will serve @ 
the educational purposes served by visual education as a whole. Each e 
has a more or less specific function. Slides and motion pictures are E 
ceedingly valuable in teaching geography, but Waddle (69) also foun 
the stereograph to be a useful tool in geography teaching. ic 

Science teachers have achieved excellent results with the microscopi 
projection and microphotographic slide. For purposes of projecting ma 
specimens and bringing interest and reality to the class, these media pe 
scarcely be equalled (73). Breechbill (11), using controlled groups 17 = 
elaborate experiment at the University of Maryland, found that expe? 
mental groups of Science students taught by use of microprojectors ap 
more uniform learning than control groups with an individual papam 
in general the pupils seem to e 
d; beginning students appear to profit more Ur? i 
uch an experiment should mean co? 


nficroprojector metho 


ifference in the preference? 
g (c) ninth- and tenth-grader* 
low in the preference of 4 

> researches in recent years hav? 
arts as well as Pictures need to be taught 


z : 1 
n ching such timely maps as are found 1" 
newspapers, magazines, almanacs, and the automobile road map Cobb 

" : 


(14) showed how these are to be used. Wise ; ice: 
showed that, with sixth-graders at least, dis esl controled ue 
and study gave greater improvement than incidenta] wl E mep Wright 
stone (77) found a gradual growth in map and graph ods, us dre 
the seventh through the twelfth grades. P^ reading ability 


he. 
asrams, cartoons, and photograP 


groups. Somewhat alone 


to miss many items in nearly ever 
seen in isolation rather than as parts of a unified tently the items aré 
One of the intriguing facts that has grown out of rm a : al 

8 Ucation stu 
pe Wider Scope of grade 
i Suon Picture, Sherman 
(62) showed that even first-grade children, some of wh, = á 
viously seen a squirrel, learned the concepts m had not pre 


of £nawin : 
ning, climbing, and sniffing the air better than through x balancing, run 


other medium- 
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Rummel ; 
that ri e using 2,100 children, Grades III through XII, concluded 
pos ve a larger grade area than has been supposed. Stadtlander 
€ to the same conclusion. 


Next Steps 


_ The foregoi ‘ 
in iud] oder review is representative of the research and literature 
(37) found ele The field has grown rapidly in recent years. Kinder 
Institution. a research is being carried on in nearly all the leading 
9f these resear viger learning in some aspect of visual education. Many 
ut more ad di are being done in connection with the master's degree, 
evenly into ad nore doctoral work is in evidence. Research divides nearly 
research iniy ministrative and technic problems. Certainly the need for 
^r. Likewise unit studies and grade level adaptations has not progressed 
Carnino » Such areas as artistic and esthetic judgments, attitudes, and 
(6) jjj P cas await much fuller treatment and. development. Bean 
Hansen ns we are on the verge of new and important developrfent 
lion, p, sho e Reed (56) have outlined a fruitful fiel@for investiga- 
Some of ther d also be pointed out that there are many studies, perhaps 
in the cla, s of restricted range, which need to be done by the teachers 
backlog mm These studies, though small in themselves, build the 
knowledge for the use of visual aids. This is as necessary as 


the l 
a 
‘ger foundation studies. 
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CHAPTER IX 


Educational Psychology 


WILLIAM CLARK TROW 


Das; TH 


PSycho] 
ory wi 
By wer ; A ia is 
and Ee: oai us under various headings in issues of the REVIEW 
reptional : teacher personnel, pupil personnel, mental hygiene, ex- 
Peng the d 
trau 

85 and W 
( erner (84)—growth and development (61), and ir 


e uring s " 
flutter é g this period the IQ controversy (94) ran rampant with a 


. © co; 
In the 
Wise 
Appear 
ed i H 
» or will appear shortly, on appraisal and 


gical 
een ; 


a and in design (100). In this chapter some of the more 
those of the — in educational psychology are reported following 
ated aboy une 1939 issue of the Review, but exclu 
Situation e. Hence the material treated will relate to t 

rather than to specific school subjects or activities. 


Snificant st 
ding the areas indi- 


he whole school 


Ti 


ne TH 
10. 
ught Processes 


Condi T 

ions, Ce which came as an an 
Ore cor. been shown by Hilgard an 
y im Kore process than the classica. 
Sugeest Plied. Responses conditioned by different perceptua ie: 
Stim, Gestalt oreanization (71) and raise the question of equivalence of 

xis n discussed at length by Hull (39). 
rs were reported by 


Stud; 
Udie, ding six yea 

8 of tr ing the preceding Si y i 
Tat; ansfer during PS and favors the more familiar ex- 
ion of experience." 


à (64 : 3 
Manatory nad — » the “reconstructi n of 
the ovcalled generalization metho thmetic (90), which “emphasized 

ay Seovery and use of relationships existing among addition combi- 
i. Ons,” proved more effective than a drill method in which each com- 
bep ton was "à ific element with no relation to any of the other num- 
ma facts,» Tha meee jnterpretations that can be given to generalization 
it, © it a convenient explanatory principle; but its scientific value, since 

nching on the waters of the dart-throwing 


am jve lau s 
ous though -— into question. An effort to repeat the experi- 


Periment, is now c# 
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swer to the behaviorists’ subvocal 


d Marquis (36) and others to be 
al Russian experimentation origi- 
] configurations 
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zed 

33) eventuated in results somewhat less favorable to genea 

eds t such, than those credited to the original reports. PME 
(47) emphasized the importance of understanding as d 

comprehending drill, memorizing, and training, and SEM I - prove 

that the use of a visual “crutch” in subtraction not only di a pupi : 
to be a handicap but facilitated the learning of both bright and s o) 1 call 
due for a revival since Dashie ; 


t 
: ugh} 
th dimension in psychology. Thou£ 


n 
^ up 
en ambiguously used (29), it turns f the 
configural conditioning experiments (70) 


law of effect, in one of which (99) 
“learning mot 


n 
whe 
gs supervision was tested W4 
teacher effectiveness w 


e an 
e basis of pupil poriormar de in 
eliable differences Were found in subsequent. pupil pun h 

= Maver ofas i upervised group. In another ups 
dangers of s ing were pointed out when high-schoo! P* -yg 

after a six wecks? į i j 
nt a year on the subj 
gy of memori 
eness of different meth: 
eriods. Stroud (85) revi 
s emphasizing th 


can be equivalent because of their mean 
content factor. Maier (59) postulated th 


F to 
i i > ree psychological processes, 
count for the various Ways in which pro 
trial-and-error; equivalenc 


uc including tr 4 
that form of concept form ich some limited aspect of a S% 
tion comes to evoke the response; and Spontaneous + : 
ing," which differs basically fro VL h die ^ 
that inductive problem-solving is ieu red. A 
abandonment of wrong hypotheses before they hay 
disproof and by a variety of hypo 
hypothesis bears an inverse relati 
bilities (74). 
p 
4 


n 
5 gio 
© received a fully 108% , 
€nce in 


0 
following out 
mber of 


" Ei 
C a theinn alternative p? 


Dd 


Influence of the Social Environment 


While hereditary influences have a determin; 


; wh 
ng influence as sh? 
by studies of identical twins reared apart and of foster children a01) 

the structure of the social environment is recognized as of tremendo 4 
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signific x 
pe Ede arme of human personality. Chaotic as is the 
Profit from a oe (46), educational psychology can definitely 
original work viia understanding of its data and technics, The most 
has been pa oe y would agree, is that being done by Lewin (52) who 
totality òf aoas topology as a geometry to represent behavior as a 
owing the field ü d facts having the character of a dynamic field. Fol. 
€ effects of nine Lippitt (55), using two children s clubs in which 
rentiated, was n and democratic leadership methods were dif- 
amiliar in the bent to clarify many socio-psychological phenomena 
Not confuse c school society. That experimentally-minded teachers may 
inefficient Lats utoeragy with petulant domination and democracy with 
classroom Lx faire, Pistor (67) has designed a rating blank listing 120 
ticipate Ae a that can be used to aid in preparing pupils to par- 
ne meth oo society. 
ey affect iba RM and problems of social research, not only as 
inder the auth chool but the wider society as well, have been summ gr izada 
time id Hicoship of several leading workers in the field (10). The 
ticularly tard technic was effectively employed by Arrington (7), par- 
he wider ne study of continuities in children’s verbal behavior. 
“Ucational social environment has begun to attract the attention of 
and other Fushalostetm, E. L. Thorndike's compendious volume (92) 
Ment oes udies (83, 91, 93) emphasize the continuity of the adjust- 
Socia] order: in which the school participates. How important the human 
Way of » T is in determining the course of development was suggested by 
absent, Ens in the reports on feral children (104) in which it is 
ends differ ; objectives sought and means chosen for obtaining the desired 
(38) fe de different cultures. The duty of education in Fascist Germany 
Süpraindiy i ier adolescent ecstasy; to be Hitler's soldier raises youth to 
quests. A idual exaltation and action and suprahuman, intoxicating con- 
Tor Yo ae (97) of a comparison of the work of the Bremen Institute 
Pplicati Study for 1926-28 and 1939-40 reveals that as a result of the 
ion of principles received from the Fiihrer, the later fourteen-year- 
hee is better physically, their characters are firmer, they need 
T discipline, but their scholastic showing is not so good. 
M the basis of several esadies, Eurer a EHE Mu pe 
s E culture traits.are not change : T ist) 10n o RSE 2 de alone, 
sin the area, class, or group- Koshuk (50) reviewe studies, made 
Ce 1925, of socio-cultural jnfluences affecting the behavior of young 
and J. E. Anderson (5) classified 


te 
hildren, indicating research trends; 1 
. © results of typical studies and enumerated the chief factors condition- 


i i s 3 2 A R 
ng socia] behavior, for example. selective social learning, social experi- 
nt, equipment, and out-of-school social 


nce provided by the environme pment, 
he teacher's record of socialization within the community 


Participation. T $ 3 
as described by Greenhow (31) is not an enviable one. 


Stric 


sira 


347 


[ 
, KI], No. 3 
Review oF EDUCATIONAL RESEARCH Vol. XII 


ietv and 
The school population is definitely influenced by the wider € "i 
also by the home environment (57); and more effective prone d 
be employed (30) in modifying the personality characteristics of 3 -— 
y means of a home-training program. But it is within the "ck NE. 
that the widest opportunities are found for improving the social aem for 
program of the younger generation. The world did not have to wa shet 
Miller and Dollard’s ingenious experiments with rats (60) to leat! M 
children imitate, Apparently those teachers who have a high degra are 
person-to-person interaction with pupils are effective as models an 


; : Rte ee ee simple 
rated high as instructors (16). Positive directions, defined as § ui 
Specific, approving, and unh 


Superior to those of the ne 
studies of the influence of th 


urried, were shown by Johnson (45) ied o 
gative type for young children. The nest vocal 
€ nursery school as such, however, are equity ore 
(42, 98) since so many other influential factors are operating. nple 
specific studies of group interaction can well be made, such for a 
— that by H. H. Anderson (3) of dominative and integrative pco 
Evaluation—A disti ture of recent developments in educati 


: : rams: 
Í measurement into evaluation ad has 
s, ta (63) concluded that evaluation sti 


Ne. : sith newe 
fully justify its being associated with n 
school practices. Yet it is the 


on 
Se newer practices that are largely resp 
sible for calling it into being. A 


two-year study (43, 102) of the apt 
activity program in a group of elementary Schools in New York 
resulted in the conclusion that the activity classes are generally equa 
superior to the traditional in intel 


ance 
1 lectual, dynamic, and social pae a 
factors, though there is evidence that they lag behind in certain sch 
subjects, mainly arithmetic and spell 


ing$ 
ing. A Survey of the research finding 
(68) of the last twenty-five years of progressive education reports no 0 
in academic proficiency and gain in terms of personal and social 
velopment. The same favorable results were r 
study (51) of college performance 


k ee of a group of students following 
freer program of studies in high school when compared with an equat? 
group taking the traditional required sub 


jects. E ually f ble, but 7? 
more detailed, are the results of the Eight-Year Stud) Rit by the 
Progressive Education Association (D p 

Morale—Resulting from the present emergency 


being published relating to the problem of morale. Š nd 
of Seolo devoted its November 1941 number ui unde gon the 
Psychological Bulletin its June 1941 number. Few of the shud reported: 
however, have a direct bearing on educational Problems — yeko B 
ogists (18, 21, 44), who have studied the effec * sh. p: 


ts of *Vacuati hoo 
i i at: scho" 
children to avoid air raids, found that though the ion of 


a 
€ported from a restric 


" re 
> à number of articles 4 


i i Problem is compl 
cated by many factors, the disturbance is often not me m is comp 
children who have been evacuated than for th 


ose who r 
Educators will need to contend with problems of adult m, 


h less for thos? 
eMained behind- 
Orale as well, for 
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which a x 
of ninety life hee analysis by Allport and others (2) based on a study 
He histories of the Nazi revolution should prove enlightening. 


Personality 


Studi : 

E ation] br tiles aspects of personality are many and often related to 
on Personali | »'ems. Schettler (78) listed topical summaries of 308 items 
Measure Was Toen The recurring problem of what the personality tests 
nce be made ak by Bernreuter (12), who recommended that refer- 
*eviewed the nt Buros's Mental Measurements Yearbook, while Super (87) 
Tan a romain on the Bernreuter Personality Inventory. Brogden 

"or analysis of forty character tests and discovered Spear- 
With ) , persistence, self-control, and acceptance of the 
e results a revision of the A-S reaction study for women (76), 

were reported: negligible correlations with intelligence, 


and pe elween submission and introversion, and .44 between ascend; 
With tsistence. Projective methods (27, 88) are gaining headway 
hes and the 


h 
Promotion sa tual secularization of psychoanalytic approat 
‘oa neplect the Rorschach technic (49). Pearson (66) called attention 
Cedres ye te aspect of experience, that of the effect of operative pro- 
Vestinati * emotional life of the child. 

Istrien tons employing the Allport Vernon Study of Values and other 
9n S of evaluative attitude were reported by Duffy (25). Researches 

‘ewed by Briggs 


What 
th 3 ( 
p ey refer to as emotionalized attitudes were review 
asis of what they con- 


“Idereq fn (13) who made their selection on the b 

by the UE be of most interest and value to teachers. A novel attempt 
Measure Se of a modified Likert technic was made by Dexter (22) to 
di Erer changes in attitude produced by speakers; and rather striking 
Bitls cane In maturity of attitudes and interests of pre- and post-menarcheal 
a the same chronological age and social status were found by Stone 


inter arker (82). Probably the most intensive and far-reaching study of 
F à iakov (81) and his collaborators; the 


Use or S is being made by Shevi : ‘ pe 
h Interest questionnaires as a disguised form of personality inventory 
lo ob ssibilities of great significance. Evidence was cited ay Süper (86) 
sts Pport the view that avocations are agate of re inter- 
toy at do not find expression in vocalions. When t he —€—— 
Hs ides the needed satisfactions, there is no competition with the avoca- 
?r an individual's interests and ene 


rgies. 


havior Variables of Educational Significance 
À number of phenomena of human personality have been investigated. 
Re that Te Bie see considerable attention derives from Dembo's con- 
Cpt of patie of aspiration, studies of which have been made by 
e T (20) that a knowledge of performance 


Tran been shown 
k (26). It Bod ences the level before firsthand experience with the 


Other groups in u 
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task but not afterwards. Also 


: their 
» subjects (37) tended to estimate U% 
expected performan 


yh d 

high if} 
ce too low if the task was easy and fags group Ë 
endency to estimate toward the mean e t Still mo 
Since the estimates were given privately. 


uc 
= Ai ed ire uns 
em of what to do with the pupils who asp 


s 
y have since relaxed somewhat, uu 
analysis by Britt and Janus (14 sory $ 
al of the bottle, puzzle boxes, mem 
e been employed to obt yi 
in children. While the phenome 


mà 
ubhu 
ed neuroses in rats and other $ hool: 


especially the f 


a children’s play situation (8). 


É have 
A number of behavior variables deserve more study than they 27) gn 


i 
i " is as VÀ 
Sness, for example, in child or adult is a 


enets of antique art p 
en tentatively analyzed Y 

(65), and in the area of social relationships, gratitude by Baumg 
Tramer (11), sows a 
In the generally neglected field of the sentiments Barry (9) as 


x in the 
ternal bereavements during childhood in care " 
undred y. i : 


efly 
ools, while nostalgia, though a problem ene en 
a fairly extensive literature (58). Jealousy an ils pe 
he most difficult problems not only among puP inte” 
also among teachers, were studied by Ankles (6) by means of an 
view technic. 


The nature 


= 


pr 


of status is Coming to acquire greater s ele 


retical problem. Writing from the Sociometric 


he question by atta 
"sons and observ! e 


: e 
> estimates W' 2 
ent criteria, the teachers’, for exam 


imple, being related i 
social participation. What Dudycha (24) called dependability,» whi? 
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consi A 
crite ee of college students in meeting appointments, 
books to the n. t-o’clock class, handing in assignments, and returning 
traits or, except cxi Pm Íound to have no relationship to Bernreuter 

ersistence gh ai dependability, to college grades. 

with sebol z hornton (95) found to correlate lower than the usual 
I5 spurious, es lc achievement and he contended that the higher figure 
_ forcement of pe on (19) demonstrated with preschool children a rein- 
stimulation persistenge after satiation in a pegboard task through social 
: These factors and many others are related to leadership, 


ough di e 
tions, x iue qualities are necessary for leadership in different situa- 
à cont er and Jordan (41) compared eighty-two college leaders with 


ir a peo and found them to be lighter in weight, younger, and 

t is doubtful, a scholarship, and interest maturity, and so forth. 

are as signifi » however, if these differences, though statistically reliable, 
Snificant as others that their technic did not reveal. 
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FOREWORD 


A numser OF THE CHAPTERS of this issue were prepared per. 
what difficult circumstances by workers who are devoting part or a 
ime to war activities. s ; 
i This is the third issue of the Review to be devoted exclusively M 
search techniques and methods. E. F. Lindquist was invited to -— 
i committee for this issue, but*when he me ^ 
giving all his available time to a new testing Bei ie the 
war duties, the Editorial Board decided to assume responsibility ine f 
planning and administration of the issue as a matter of po E 
firsthand the work which committees are called upon to do. This isa when 
tion somewhat similar to that surrounding the first issue on this topic 
Frank N. Freeman, then chairman n 
chairmanship of the special issue of February 1934 on “Methods ? 
Technics of Educational Research.’ 
end of the first three «4 pot 
devoted to “Methods of Research in Education," December 1939, did ! 
appear “ill the end of the ninth 
of the Review, in other words, 
cifically the advances and pra 
here were, however, several 


wW 
EVIÉ 
© present issue comes at the end of the fourth cycle of the R 


esearch methods of the past three years. w was 
issue, under the chairmanship of Carter V. Gooi jine 
en chapters, the present issue condenses the 5 fio 
arger areas. This was done primarily in a adde 
e issue. The topic of "appraisal" has ger he 
at the direction of the Editorial Board. As is usually the case weng 
good material has had to be sacrificed to keep the io 
i in bounds, and contributors have foregone the mus et 
many references in their bibliographies which an unlimited printing 
would have permitted. W 
is ane at the Review concludes the first full experience with the y 7 
schedule of topics which was adopted by the Editorial Board at ita n 
ings in 1938 and 1939; This schedule involved the experiment of pM 
five issues dealing with particular subjectmatter fields or areas, rather "S 
aving these several fields treated under an organization which separa de 
each one of them into elementary-school methods, igh-school metho, 
psychology, measurement, and curriculum. The first three cycles of 
Review followed the earlier pattern with only minor changes, de 
€ experiment with the new list of topics has Seemed, at least for 


present, to be satisfactory and the schedule is being Continued for the ne” 
458 


Cycle i : 
Ure vend the same form. An effort, however, will be made to 
arts will be u E ii) which occurred in October 1941. Accordingly, fine 
issue. A ne, T ined with. the language arts and appear as the April 1943 
title oe i e, | Education for Work and Citizenship,” will replace the 
e erri Pa and will be somewhat broader. Special attention 
EN Sopa the war and education will be given in the February 1943 
E al is devoted to “The Social Background of Education"; and later 
so will deal with the war as it impinges upon their several areas. 


Doucras E. ScATES 
Chairman of the Editorial Board 
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CHAPTER I 


Bibliographical and Documentary Techniques in 


ducation, Psychology, and Social Science 
CARTER Y. GOOD 
. . . 4 re 
Tus CHAPTER is concerned with recent literature on research proceda 
which depend primarily on the utilization of documentary sources. E. 
topics treated include (a) library guides and tools in education, P 


. H H H rch; 
chology, and other social sciences; (b) historiography and legal resea 
and (c) documentary reproduction. 


New Library Guides and Tools in Education 


ee z ides 
Limitations of Space permit the listing of only the recently issued gu! 
most he]pfu] 


Ao. 
Cedures'in education (4) providing a recent comprehensive presenta D 
orpe’s brief guide (207) is useful, although the attempt to cover in " 
notated fashion the Sources for educational research in only Zahia 
has resulted in omissions and in some inaccuracies. The guide by Wi dé ^ 
and Stevenson (228) is pointed primarily toward the needs of ee 
graduates but should prove helpful to many graduate students. mel 
individual bibliographies and major summaries of research are bic 
only in lerms of the guides for locating them. Most of the guides W this 
Were regularly published before 1936 were summarized earlier by ass 
writer (87) and are not reviewed again here. It should be noted in P. al 
ing, however, that the chief serial guides at that time are still the princi? e 
tools for library work in education, notably, the Education Inder iy 
annual U. S. Office of Education Bibliography of Research Studies in the 
cation (90), the bibliographies in the Elementary School Journal an " 
chool Review (which Were assembled annually and published as a mo? 
graph up to the 1938 references) , Education Abstracts, and the REVIEW " 
EDUCATIONAL RESEARCH itself. The Readers’ Guide to Periodical Liter un 
and the Tnternational Index to Periodicals continue to render supplem 
lary service, ] 
A valuable tool for canvassing educational research literature in gener? 
and for Obtaining overview treatments of various Problems is the Encycl? 
pedia of Educational Research (138) directed by W, s, Monroe and spo?" 
sored by the American Educational Research Association, There are som 
gaps in the topics covered. The REVIEW OF EDUCATIONAL Resrarcu, als? 
Sponsored by the Research Association, is a major guide, providing ove” 
views and bibliographies of research in problem areas. As a rule, it ha5 
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incl : 
(as not aras m subdivisions of education within a three-year cycle 
PAM ris ct vere y on the inside back cover). A twelve-year index of the 
of the Social S EVIEW is now in process of preparation. The Encyclopedia 
most of the romper contains some material on education, as do 
socia A . m es cited in the following sections on psychology and other 
L de ie guide from 1910 or earlier to 1935 is the Monroe and 
isted unde og of more than 4,000 annotated bibliographies and summaries 
Up to dat r author and subject in one alphabet. This listing has been kept 
ibliogra d 2I 1935 in part by the Education Index. and also by the 
ographice, uc ndex (21). This latter isa quarterly bibliography of bibli- 
e ünr iln a wide range of subjects, including various educational heads. 
Phy of ed umber was published in March 1938. A recent, brief bibliogra- 
hm ucational bibliographies was prepared by Brickman (28). The 
especial] y of Education (3, 82) will be helpful as a means of orientation, 
y in clarifying concepts. 
^ may be defined as “any 
ts more or less regularly” 
o periodicals or serials. 


ly educational, gMuld be 
d periodicals 
list of 


G . 

sin fo. periodicals and serials— Serials" 
Ma issued serially or in successive parl 

number uf. of the tools already cited relate to 

Noted, T] general lists of serials, not necessari 

b he Ayer list (15) is a bibliography of newspapers an 


anada, Ulri libraries in the United © 
lished + lrich's list of 10,200 titles (208) represents the periodicals pub- 
hBlanq. the United States and in foreign countries, especially those of 
Collectio, France, and Germany, that have proved most useful in American 
Colle ons. Lyle (131) has grouped his classified list of periodicals for the 
8e library by academic fie detailed information 
referred to selected 


Sour, 
Ces (2, 4, 14, 234). These references © 
by the various indexes to t 


d monographs—The 
s and monographs in education. School 


n of an annual classified list of 
and bulletins, with a selected 


Ls to educational books an Education Index is 
Je most useful guide to book | 
ociety has continued its publicatio 


Ucati i 
Yer cational books, monographs yearbooks, ? 
St of sixty books ae | with an asterisk (221). The titles of the sixty 


poks of the year also appear in the April number of the Journal of the 
14). The United States Catalog is kept 


ati, n 
up tonal Education Association (114. 3 
n to date by the monthly Cumulative Book Index, which cumulates at 
Tegular intervals during the Year» annually into a supplement, and after 

evera] yenta antosal large supplement. Each entry includes information 
i edition, date, publisher, price, and paging. In a 

Sense, the Publishers” Weekly supplements the monthly Cumulative Book 
ibes and indexes new books in a convenient reference 


"dex, in that it describe: 
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and buying list. Selected bibliographies of books, such as pos 
Catalog and supplements, are helpful. For volumes later than 19 ^ ks 
Booklist provides semimonthly selections and evaluations of 4000 
The Book Review Digest offers guidance in the evaluation of some 4, for 
books during the course of a year. Detailed bibliographical references 4 
these publications have been given earlier (87) and will not be mpeses 
Bridges (29) listed two hundred series of professional books, bulletins, an 
monographs in education published since 1900. 


" > and 
Guides to graduate theses—The comprehensive guide to masters’ an 


doctors’ theses in education continues to be the annual Bibliography of Re- 
search Studies in Education (90) 


of the U. S. Office of Education. prem 
ning with the titles of 1912, the Library of Congress printed an enum 
ses in all fields; this ceased publication 
with the theses of 1938 (211). Because this publication was usually two 
years late and omitted unpublished theses, another agency began a complete 
annual listing (61) with the titles of 1933-34, and since the year 1938, has 
been alone in carrying forward this work. Doctors’ theses under way in edu- 
i i ly, beginning with 1931, in the TAI 
t (83). Reference may be made to an annua 
in school law, with a list of masters’ theses 
in the same field, and to an annual li 


al listing (65) of the recipients of doctors 
ign languages, 

volumes or lists of their nene 
À uate work of the particular university bu 
sometimes devo les or lists of the theses in education alone- 
A basic guide (156) mmaries and lists of theses is available. An 
older source ( Prove helpful. The annual Bibliography of 
Research Studies in Education (90) lists such institutional summaries 
" educational — reports,» The Education 


1 5 * : ca- 
uidance under the topics of: “Dissertations, 4 
educational” 


. 6 : oc- 
3 “Degrees, academic”; “Degrees, d 
egrees, masters??? 


d since 1 inistration (35): 
school law (59, 99), teacher ERN oe School administra 


1 i 19), testing 
(195), Vibes, (161). isi ( 26), adult education ( 
health education (78), h 


andicappeq 
(97), industrial arts (89) dan ) 
Boy Scouts (133) ons of the U. S. Office of Education (214): 
Yearbooks dealing with menta] measurements (36, 37, 38, 39, 40), = 
with research and statistical methodology (41, 42) ine the student an 
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occupational titles (210), and philosophy (16, 181) provide orientation 
for interpretation of the concepts represented. 


Serial bibliographies and summaries in limited areas of education— 

Many of the previously described comprehensive guides to the literature 

s ' — are in effect continuing bibliographies. There are also serial bibliographies 
or summaries of research for a number of specifically limited subdivisions 

i of education. Most such references are annual in their appearance and have 


J 

j) continued over a number of years. As a rule, the bibliography of summary 
P" for a particular year refers the reader to the earlier numbers in the series. 
A. Selected topics represented in the bibliography of this chapter are educa- 


| tional books of the year (222), major educational projects and large-scale 
| investigations (84, 188), deliberative committee reports (43), methods of 
| research (99), teacher supply and demand (71), junior college (70), 
| courses of study and curriculum materials (32), curriculum making (125), 
| reading (91), science teaching (58), modern language teaching (205), 
| physical education (2), and Negro education (119, 120, 166). 


Bibliographical, institutional, organization, and statistical directories in 
education—A number of handbooks of information and directories include 
biographical facts concerning individuals or statistical or personnel datam & 
for institutions. Among the overlapping illustrative references of@his type 
are those dealing with leaders in education (46, 225), specialists in philoso- 
| phy (226), college and university presidents (171), public and private 

schools (158), universities and colleges (132), special resources in 765 
libraries (218), school supplies and equipment (187), educational build- 
ings and grounds (10), individual professional organizations (5, 33, 190, 
| 223), and registration statistics of higher education (218). The most 
widely used educational directory (212) probably is that issued annually 
in four parts by the U. S. Office of Education: I. State and County School 
Officers, II. City School Officers, III. Colleges and Universities, and IV. 
Educational Associations and Directors. The educational and social direc- 
tories and yearbooks for 1942 listed in Part IV of this Office of Education 
publication (213) number eighty-one. If publications are issued by the 
| educational and learned associations, such journals, yearbooks, or proceed- 
ings are named. The general biographical directories—Who’s Who in 
| America, Who's Who, and the International Who's Who (109) —include a 


considerable number of educators. The Directory of American Scholars 
(44) includes a large number of professors, though not mainly in depart- 


ments of education. 


Guides to Psychological Literature and Data 
Many of the educational guides cover a considerable amount of psycho- 
fact, there are certain areas where it is difficult, if not 


logical research. In pL Se! 

impossible, to draw a sharp line between the two disciplines; for example, 
learning and conditioning, personality and character, vocational guidance, 
mental tests, or childhood and adolescence. Therefore, for selected topics 


the student of psychology may find pertinent information in the previously 
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described educational guides, including the Encyclopedia af a 
Research, Education Index, and REVIEW OF "P wed 7 g oe 
There may be times when the student may find it desira a ce 
guides for all the several areas (education, bie and social s 
i ed in this chapter in working out a single problem. : 

pus major E no guide to the literature of apes n] b 
monthly journal Psychological Abstracts (172) founded in 19 nee 
author and subject index to the abstracts printed during each year is is a 
as an extra number each December. The Psychological Index (174), es ea 
lished in 1895, suspended publication in 1936. From 1927 to 1936 E 
two journals performed an overlapping service. As the titles of the pu 


cations indicate, one includes abstracts or brief 


summaries while the other 
is merely an index or li 


st of references. For publications prior to 1927 E 
Psychological Index is the only major comprehensive guide pan e. 
Both of these publications cover periodical literature, books, monographs, 
and published theses. 

A list of topics in 


psychology should prove useful in identifying appro- 
priate headings for c 


anvassing psychological materials (95). A wari 
sychology (130) and a compilation of available bibli- 
ographi¥s (129) are valuable for the periods represented. In certain large 
areas of psychology extensive summaries and guides have been provided: 
general experimental psychology (144), social psychology (145), and child 
psychology (143). The monthly Psychological Bulletin (173) usually 
publishes one or more critical surveys of the literature dealing with a spe- 
cific psychological problem. Psychology is well equipped with dictionaries 
(16, 74, 75, 105, 220), which perform an orientation function in the 
interpretation of psychological terms, concepts, principles, and procedures. 


psychology—Two volumes of the Psy — 
logical Register (147), a biographical and bibliographical directory © 
American and foreign psychologists, appeared in 1929 and 1932, respeo" 
tively. The 1932 volume included 2,400 psychologists from forty wed 
À projected first volume is to include psychologists who had died before the 
inauguration of the series, extending back as far as the Greck aee 
or more recent information, the yearbook of the American Psychologica 
Association may be consulted, although this annual publication ial? 
only the name, training, position, field of instruction, and major dapes 
interests of each individual. The 1942 yearbook lists 713 members on 
2,518 associates, American Men of Science (45) contains the tare 
of a number of the more eminent psychologists. Many of the prevent 
listed educational and general directories include information d 
certain psychologists, especially those engaged in teaching gipebon 
psychology or serving in administrative positions. The three-volume H ie 
tory of Psychology in Autobiography (146) consists of extended resumes 
of the lives and works of selected psychologists, most of whom are living. 
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Guides to Literature and Data in Other Social Sciences 


Certain of the general educational guides described earlier in this chap- 

ter contain considerable material of interest to workers in other areas of 

1 the social sciences. This statement is especially applicable to the Encyclo- 

pedia of Educational Research, the Education Index, the Review or Epuca- 

TIONAL Researcu, the Bibliographic Index, and also the annual methodo- 

logical summary in the September issue of the Journal of ' Educational 
Research. 

The basic reference tool for the social sciences in general is the fifteen- 
volume Encyclopedia of the Social Sciences (189), covering the fields of 
anthropology, economics, education, history, law, philosophy, political 
science, psychology, social work, sociology, and statistics. Its purpose is to 
| provide a synopsis of progress in these areas and a repository of facts and 

principles. It includes biographical articles and bibliographies. 

; The London Bibliography of the Social Sciences (128) is a valuable com- 
pilation of some 6,000,000 entries, arranged alphabetically by subject with 
an author index, and based on the holdings of nine London libraries. 
Public Affairs Information Service (175) is a comprehensive index of 

i periodicals, books, pamphlets, and other materials, particularly those wihh® & 
emphasis on sociology, economics, and political science. It is PAblished 
weekly and cumulates five times a year and annually. Social Science 
Abstracts promised to solve the indexing and abstracting problems of the 
Social science subjects but could finance itself for only four years, 1929-32. 

The result is four volumes plus an index. Much of the pamphlet material 
indexed in the Vertical File Service Catalog (216) is pertinent to the social 
science fields. Much social science material is indexed in the general peri- 
odical guides. 

The titles of certain journ 


als dealing with the social science fields may 
be located in the sources described in the section on guides in education. 
The index volume of Social Science Abstracts contains a long list of the 
journals represented. The yearbook of the Educational Press Association 
of America includes the titles of the social science journals of most interest 


to workers in education. 
Other useful tools in the s 

Search guides and references 

search. The comprehensive gui 


ocial sciences are a compilation (115) of re- 
and a bibliography (57) on methods of re- 
des to published books and to theses 
described in the section on education may be used for canvassing such 
materials in the social sciences. In addition, certain continuing or serial 
guides to theses in sociology and in history are published annually: doc- 
tors’ and masters? studies under way in sociology (8), graduate degrees 
| conferred in sociology (8a), and doctorate dissertations in progress in 
b history (6). 
s and problems of the social sciences—Especially 
ared for certain subdivisions of the social 
(20, 55, 67, 107), dictionaries of Ameri- 
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can biography (110) and of American history (1), and a guide p 
terials in political science (34). Dictionaries of terms in osi ied 
and in social work (240) are available. The publications of the Uni 
sity of Chicago faculty in sociology were listed by Wirth (281). — i 

The annual census of social research (24) conducted by the America 
Sociological Society uses the subheadings of social psychology, wies 
and theory, methods of research, social statistics, social biology, "— ogy 
and psychiatry, human ecology, rural sociology, educational socio gan 
community problems, sociology and social work, the family, sociology 
religion, criminology, and political sociology. 

Social science directories an 
equipped with direct 
The annual education 


d yearbooks—The social sciences are well 
ories and statistical and current events yearbooks. 
al directory published by the Office of Education in- 
cludes a useful list of educational and social directories and yearbooks, as 
well as a compilation of educational, civic, and learned associations in the 
United States. A mor 


technical organization t 
153) of organized research in the social sciences are now out-of-date bu 
^ Gmay prove useful for 

There“are director social work agencies (193), political leaders 
and programs (163), and municipal officers and activities (141, 142). 
The social sciences are well represented in the new Biographical Directory 
of American Scholars (44). Four of the widely used annual handbooks 
rld Almanac (236), Statesman’s Yearbook 
(11), and Statistical Abstract of the United 
er known encyclopedias publish annual sup- 
plements (12, 30, 151, 237). 


contain much biographical information concerning the workers in these 
elds. 


e education has been summarized in Ed 
8), while the historiography of three year 


(88) in the December 1939 issue of the REVIEW 
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The two-volume work by Thompson (206), published in the fall of j 


1942, is the most comprehensive review of historical writing in print, 
covering the period from earliest antiquity to the outbreak of the First 
World War, although no living historian is included and by intent no 
American writer is mentioned. In surveying the changing conceptions of 
history and the various fashions of writing it, Thompson fitted each author 
into the general intellectual background of the age represented and assigned 
to each writer his place in the development of the contemporary historiog- 
raphy. Barnes, in a single volume (17), appears to have been the first to 
attempt a history of historical writing for substantially the entire period of 
recorded knowledge, with the: result that parts of his book read like a roll 
call of historians or a running bibliography. However, Barnes's plan of 
characterizing the intellectual background of each major period, of show- 
ing how the historical literature of each era is related to its parent culture, 
of indicating the dominant traits of such historical writing, and of identify- 
ing the individual contributions of the chief writers of each period has defi- 
nite advantages by way of synthesis over individual literary essays on a 
group of historians or over any encyclopedic bibliography of historical 
writing. Shotwell (192) dealt with early records and evaluated in detail 
the contributions of Jewish, Greek, Roman, and Christian historigal writ- 
ings. Shotwell has planned a second volume to cover the period from early 
Christian times to the present. 
A number of other histories of history cover more limited areas. Kraus 
(121) provided the first survey of the whole field of American historical 
writing. Three recent volumes of essays in historiography, written by 
former students of particular institutions, are significant: two series in 
American historiography (81, 106) and one dealing with selected historians 
of modern Europe (186). : 
Among the recent manuals directed chiefly toward the needs of beginners 
in historical writing, Nevins’ Gateway to History (150) is especially com- 
prehensive, with a multitude of interesting illustrations drawn largely 
from American history and biography. Kent (117) offered advice to the 
undergraduate senior and beginning graduate student in history i an 
attractive, forceful style. Good's briefer analysis (86) of selected problems 
of historiçal criticism, interpretation, and writing synthesized points of 
view and examples from a considerable number of full-size treatises in 
historiography. Other fairly general discussions of the writing of history 
are those by Hulme (104), Kellett (116), Oman (154), and Taylor Co 
Varied approaches, philosophies, and interpretative concepts i his- 
torical writing are represented in the literature of historiography during 


rec g ore comprehensive treatments are discussions 
of beh or TE bee hi relation to biography (111) , culture 
(185 219) tenoro forces (08, 124), liherty (56) tend un dee 
Science (135, 182), social science (168), and theory and philosophy (155, 
205). 
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i icati f the 
e permits mention of only the more extensive applications o : 

eor dde during approximately the past decade to pesi 
and social science. Dunlap (66) characterized a large number o e ri 
treatises (old and new) in psychology under the headings o eam 
surveys, surveys of periods, and expositions of the views of eer 
men or groups, source books, biography, and general histories of m 
ogy. Selected, comprehensive histories of psychology are those by a 
(23), Flugel (79), Murchison (146), Murphy (148), and Spear at 
(196). Within the past few years histories have been written for sev 


areas of the social sciences: anthropology (159), economics (112), socia 
thought (18, 73), and sociology (103). 


This brief review of the lit 
sibility of yet another step in 
of historical writing. 
pired, then records 
such documents, 
historiography, 


erature of historiography suggests the pos: 
historical writing —*a history of the histories 
" In the course of human affairs events have trans- 
of events have appeared, next the history based on 
considerably later the discussions of historical method or 
and recently the histories of historical writing. 
Summaries of Legal Research 

Legal; research in education is a special application of the historical 
method. The documentary Sources utilized are (a) statutory law (consti 
tutional provisions and legislative or Statutory enactments) and (b) case 
or common law (principles applied by the courts in deciding issues m 
covered by statutory law), Legal research shares with the historical metho 
in general similar techniques for exploration of the sources, criticism © 
documents, and interpretation. 


During the past three years, 1940-41-42, the annual Yearbook of School 


] 4 Á 3 rith 
Law (54) has continued as the outstanding publication in this field, n 
its contents devoted primarily to a narrative topical summary of decisi 


3 . r Á í ing 
of the higher courts in all states of the United States in cases involving 
school law, as reported duri 


publication in educational law for the three-year 
period is the volume by Hamilton and Mort (96). which is a pene 
textbook and casebook directed especially toward the problems of ae 
tional administration. Chambers (47) has extended the 1936 volume, 
Colleges and the Courts ( 
ing higher education in the United States from 1936 through 1940. xci 
policy of the Review or EDUCATIONAL RESEA re 
egal aspects of an educational problem AT 
ases of the same problem are considered, oe mue 
e number of the journal exclusively to schoo fant 
€e years parts of certain numbers of the REVIEW 1 
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j 4 


dealt with the legal phases of school organization and administration 
( 179) , finance and business administration (49), planning and construct- 
ing school buildings (31), the status of teachers (221), and research 
literature (53). 


— — — oa 
& 


Documentary Reproduction 


Microphotography within the past decade has become the major method 

j of reproducing research materials and has brought about for the historian 
"y a revolution in methods of work second in importance only to the develop- . 

ment of printing (76). The recency of the development of the several 

techniques of documentary reproduction, especially microphotography or 
microcopying, is indicated by the appearance in 1936 of Binkley's manual 
(22), which is the first detailed account of the various modern methods 
of reproducing research materials. In a sense, this manual is the parent 
of the Journal of Documentary Reproduction (113), since one reason for 
founding the journal in 1938 was to continue and keep up to date Binkley's 
r pioneer work. Parts of the manual have been superseded by later and 
| briefer publications but it is still the only basic reference volume for the 
subjects covered. Developments of 1936 and 1937 are covered in the two. 
volumes (176, 177) that report the papers presented as micropho| graphy 9 
symposia at the 1936 and 1937 conferences of the American Library 
Association. 
` There are four major uses (27, 122, 170, 201) of microphotography 
i in furthering the work of scholars and research workers: 
| l. Negatives of materials not available in local libraries or in any single library 
| may be made in many distant places and combined into a complete collection or 


Series; for example, a newspaper or journal series or some other periodical collection. 
2. Materials from distant libraries that cannot be visited, particularly collections 


in foreign countries, can be reproduced for Jocal use. : ; k . 
3. Original publication of research, such as doctoral dissertations, is possible. 
University Microfilms publishes at intervals a volume of abstracts (134) of doctoral 
nicrofilm. Power (169) has outlined 


theses that are available in complete form on m 


the problems and procedures involved in publication of theses by microfilm. Paul 
ion combines the process of 


Monroe's work (136, 137) on the history of educat ^ 
: rinting T " c d microfilm (Volume II, a collection of 
| ela Pune LH eie d ferred to in the textbook). 


Teadings from the documents and source materials refer e A 
4. Preservation of documents that face disintegration, destruction, or damage 


through the ravages of time, wear, fire, or war. The space saved in the case of bulky 
materials, such as newspapers, is considerable; a filmed volume on a newspaper occupies 


approximately one-fiftieth of the space of the original. 

" The rapidity with which the work of microcopying has progressed is 
evidenced by the new Union List of Microfilms (160), which includes 
5,221 items. The editorial committee in charge of this list hopes to issue 
annual supplements to keep the compilation up to date. Descriptions of the 
Microcopying projects of jadividual libraries or organizations are avail- 
able in the literature (76, 118, 201). Stewart (200) outlined fifteen prob- 
lems to be solved together with recommendations for improving the uses 


of microphotography for scholarly purposes. 
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CHAPTER II 


Analytic, Synthetic, and Diagnostic Studies of 
Individuals' 


RUTH M. STRANG 


Mernons OF STUDYING PERSONALITY have far broader applications today 
than ever before. They are essential to effective war effort and to the 
implementation of democratic principles. Prediction is necessary in the 
placement of personnel in the military services and in the selection of 
personnel in government and industry. In the problems of postwar recon- 
struction a knowledge of the unique contribution each person can make 
will be. basic to the effective functioning of a democratic society. 

_ Theories of personality may either be derived from novel variations 
in methodology, or they may dictate the methods of study employed in a 


given research. In the former instance, new light may be, thrown on the 


structure and organization of personality; in the latter instance, the theory 
s of personality a® repre- 


may be extended or clarified. Various theorie 

sented in the publications of the last three years, but the most significant 
advances have been in the direction of study of the inner organization 
and the uniqueness of personality. 


Persistence and Limitations of Paper-and-Pencil Tests 


In his 1940 review of trends in clinical procedures and psychotherapy, 
Watson (80) noted the marked decline in interest in paper-and-pencil 
personality tests. Yet in spite of the skepticism regarding these instru- 
ments as repeatedly expressed by clinical workers, the experimental 
evidence of their lack of validity, and the arguments against this method 
of assessing personality a ized by Vernon (79), new inventories 


s summari 
and scales are still being devised, each with some unique and commend- 
able. feature.? Although the paper-and-pen 


cil tests have.some value as 
Screening devices for detecting maladjustment in groups, as approaches 
to the interview, and as a basis for clinical study of individual responses 
and patterns of responses, interest in these instruments is being supplanted 
in recent literature by more enlightening and more valid approaches. 


New Uses of Familiar Instruments 


The use of definitely structured material such as standardized tests has 
Certain qualitative possibilities. These qualitative aspects are emphasized 


—— 

E 1 The author is indebted to Margaret M 
ection on "Diagnosis of Difficulty in Si 
vaste Chapters VI and VII of this issue of the Review 
arius human traits or abilities. 


cKim for assistance in locating and reviewing references in the 
chool Subjects." 
for further discussions of means of assessing 
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in the administration of the Bellevue-Wechsler intelligence test e 
For example, the way in which a subject defines the words m a 
vocabulary test tells a good deal about the "quality and aie oc th 
thought processes," his cultural milieu, and schizophrenic ten as 
Observation of a subject at work on the object assembly e cda 
something about his thinking and working habits, ability to wor eitis 
an unknown goal, persistence in completing a task, and apoE m E 
and mechanical ability. Porteus (64) recognized similar possibili sin 
the maze tests, offering as they do relatively great latitude of for atje 
to the subject and thus providing “particularly fertile material Pis i 
aspects of personality diagnosis." Gerlach (27) made a contributi indi- 
methodology in her comparison between psychometric pattern d oak 
cated by the Stanford-Binet and Cornell-Coxe quotients and asocia 
aggressive personality types as found in case histories. : f P 
Another example of new uses of old tests for personality o 
the new scoring keys for the Strong Vocational Interest Blank. elh. 
(78) reported that the validities of the keys in the areas of home, i 
and emotional adjustment were low, but that self-confidence and poe (72) 
could be predicted fairly accurately by this method. Sheviakov's work | i 
3 Gis another example of the clinical treatment of a psychometric € = 
Tnstead'òf merely taking the items on the interest test at their face Va de 
Sheviakov grouped and studied the responses in various ways and ie 
able to construct an apparently valid personality picture of each etes 
The diagnosis of personality through a study of the relationships MR 
tests or parts of tests and through attention to the qualitative — 
a person's responses is a promising development, probably stimulate 


"e. A un- 
by the success of the clinical treatment of subjects’ responses tO 
structured situations, 


Personal Documents and Self-Analysis 


: PE ET rvey 
The most Important contribution in this area is the historical $U 
and evaluation of 


- e 
the critical literature and experimental studies m4 
by Allport (3). 


tentionally 


any self-revealing record that in! nce 


5 fu 
rding the structure, dynamics, 8n! 
al life, (3, xii) 


ru nformation Tega: 
tioning of the author's ment: 


There are various forms of “first- 
personal accounts, with no checks or technical aspects, to critica 
experimental studies, Included es- 
questionnaire responses, verbatim recordings, diaries, letters, and eXP7 u 
sive and projective documents. Allport found personal documents T 
in research, in teaching, j 

gies, and in social psych 
documents with their dis. 
or trivial. 
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A high point in the intentionally revealing personal document is repre- 
sented by the self-analysis of “Clare” reported by Horney (39). In this 
case the procedure by which a patient may not only let her thoughts, 
feelings, and impulses emerge, but also use her critical intelligence in 
their interpretation, is minutely described. Such a document reveals the 

why” of behavior as the patient sees it in her effort to effect a better 
adjustment. The value of such a self-analysis for research on the springs 


of conduct is obvious. 


New Emphases in Observation 


The technique of observation was so comprehensively reviewed by 
Jersild in the December 1939 issue of the Review that little need be 
added here about this important instrument of scientific research. Perhaps 
the chief developments during the past three years have been its applica- 
tion on the college level, whereas formerly the vast majority of investiga- 
tions were in the preschool field; and more use of the method as part 
of a unified approach to the study of the individual as a whole. Jarvie 
and Ellingson (41) described in detail, with many examples, the recording 
of behavior and the interpreting and implementing of the “anecdotal 
behavior journal” in their institution. McCormick (53) conclu from 
his experience with anecdotal records in the secondary schools o pring- 
field, Missouri, that this form of observation “has proved to bea feasible 
and useful technique” in the public school. An example of the clinical 
diagnostic use of observation was described by Brown (13) who used an 
experimental situation in which to observe the reactions of psychiatric 
patients to thwarting. He found a continuum of reactions which suggested 
to Watson (80) a possible “objective analysis of psychoses which are 
now measured only with adjectives like ‘mild’ and ‘severe.’ " 

The most pervasive use of observation during this three-year period 
was reported by Lerner and Murphy (51). In their research observation 
was the basic method not only in natural nursery-school situations, during 
the intelligence testing and the pediatric examination and with the music 
teacher, but also in a variety of experimental situations. The emphasis in 
all these observations was on the “how” and the “why” of behavior. Every 
activity carried on in the nursery school was considered as an opportunity 
“to understand what it must feel like to be this 3- or 4-year-old, BI eser 
to help children to be their most effective selves” (51: 247). 


Single-Aspect Approaches 


The approach to personality through a single aspect might be called 
the “flower-in-the-crannied-wall” technique. It is true that an individual’s 
pattern of personality may be revealed through his handwriting, his gait 
and other expressive movements, his speech (70), his free associations 
(30), and his sense of security (69). . 

. The biological basis of personality and the chemical substratum must 


also be recognized. *Certainly all individuals cannot respond similarly 
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si d 
to exactly the same experiences. This fact in itself demands pesi dap 
explanation" (73). Kahn (46) advocated an endocrine examin ci 
determine whether a flyer’s symptoms of tenseness and nervot = de 
insomnia, and psychomotor tension are due to maladjusted endigi ks 
to hereditary structural and physiological weakness of the nervou eif 
tem. Methods and instruments used in studying anatomical, biochem ce 
Physiological, and medical aspects of adolescent development are 


scribed in detail by Greulich (32). 
The “Interpersonal Relations” Approach 


” 

The definition of personality as a person’s “social stimulus exu 
naturally leads to a methodology involving classmates or -€— ES 
opinions or ratings. Using a modified form of the "guess who Pe eae! 
Tryon (77) was able to make especially enlightening sketches of an wy ei 
children who received extremes of scores derived from classmates Lis Med 
Jennings (42) advocated the study not only of “the individual s war mt 
Social expression choice and rejection of others but similarly m" ame 
sion of other persons toward him." Bonney (12), Zeleny (84), and 1 ast 

, others reported sociometric investigations in Sociometry during the tr it 
— three goars. The study of the individual as a social atom throws J s 
on such problems as the choice process and patterns, on the characteristic 


d $ oH ith indi- 
of persons in isolated or near-isolated positions as contrasted with oar 
viduals in leader positions, and the consistency of the “internal struc 

of the social atom (42). 


Developmental Approaches 


The genetic approach to the study of personality need merely be nly 
tioned here because the December 1941 issue of the Review dealt ait 
with the topic Growth and Development. Since changes in structure lop- 
closely correlated with changes in function, the clinical study of deve OF 


: sy, This 
ment makes an important contribution to the study of personality: Es 
point of view is exemplified in Developmental Diagnosis by Gese 
Amatruda (28) and by Campb 


À : L to 
i ell and Weech (19) in their pog e 
arrive at a mathematical description of certain aspects of a child's 
opment against the backeroun 


d furnished by his peers. 
The Case Method 


Olson’s review of the case method in the December 1939 issue of a 
REVIEW opened up a wide field of usefulness in “the establishment , e 
professional practices and scientific generalizations.” His emphasis 0? ion 
value of case studies for administrative information, for the evaluat! 


A : idation 
of programs, for curriculum and instruction, for illustration and valida 
of statistical results, and 


SO E igina 
for scientific generalizations was an orig 
and significant contribution. 


CP à ize 
The three most significant trends are (a) the attempts to standardia 
and to quantify case studies, (b) the use of case studies in the predic! 
482. 
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of personal adjustment, and (c) the application of statistical method to 
the single case. None of the statistical methods—statistical treatment of 
each item or factor as an independent unit, partial and multiple correla- 
tion, factor analysis, matrix algebra—have been wholly satisfactory. 
Burgess (17) reviewed four possible procedures: (a) intuitive generaliza- 
tion, (b) analysis of the case in all its individuality, (c) prediction by 
way of typology, and (d) analysis of the data according to fourteen 
factors that seemed to be dynamic. After applying the fourth procedure, 
Burgess questioned “whether a scientific method of analyzing factors will 
be superior, or even equal to the intuitions of persons gifted with deep 
understanding of human nature” (17:348). 

The use of case studies in the prediction of personal adjustment is most 
thoroughly reviewed by Horst and collaborators (40), with the conclusion 
that case study data are definitely relevant for prediction. Stouffer (74) 
suggested a fusion of the intuitive and the statistical approaches: the 
intuitive selection of variates or configurations which the investigator 
thinks important in an individual and the comparison of this dynamic 
configuration with that of other individuals whose success or failure is 
known or with time-sequence records of success and failure within the 


individual case. The study of cases, according to Cottrell (20), $ aimed? 


at isolating syndromes and typical personality patterns which experience 
g behavior, problems in 


has shown to be correlated with certain resulting 
adjustment, success or failure in some activity" (20:369). The study of 
cases involves the three steps of synthesis, genesis, and prediction: (a) how 
one views his life situations; (b) how one came to have such a point of 
view; and (c) what one's attitudes and overt responses are most likely 
to be under specified circumstances. 

The use of prediction as an approach to the study of personality as a 
whole was suggested some years ago by Barbara Burks and facetiously 
called the *He Would" technique. More recently F. H. Allport and 
Frederiksen (1) applied this method with college students as experi- 
menters and subjects. Their predictions of responses which acquaintances 
would make to a verbal dilemma were only slightly better than chance, 
but would probably have been much higher if "the teleonomic pattern had 
been successfully predicted." : . 

The application of statistical methods to the single case introduces “a 
new conception of a ‘population’ for statistics—a population of events 
and traits within the boundaries of one person" (3). By dividing material 
on an individual case into incidents which are then classified according 
to object discussed and attitude expressed, Baldwin (4) built the structure 
of an individual's personality pattern which agreed closely with clinical 


judgments of the original material. 


Projective Methods 


The materials of projective 
Sou: aa A 
situation which is unfamiliar or “un 


methods present to the subject a stimulus- 
structured”; in responding to this 
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situation he reveals the way in which he organizes experience, and s 
the skilful investigator gains insight into the subjects e e w sare 
meanings, significances, patterns and feelings” (25). This is ie said 
of the various projective techniques. They constitute the TH ae 
thus far evolved of studying the individual as a dynamic whole. The os 
widely used of these techniques is the Rorschach test. A great cee: de 
interest in the Rorschach test has been evident during the last a 
years. The Rorschach Research Exchange has been active in peo 
experience and mutual criticism and the American Journal of dy d 
Dsychiatry has published numerous articles on technical aspects M Ne 
Rorschach test. Two books, both containing extensive bibliograp es = 
have recently been published giving details of administration, yos ^ 
and interpretation. Klopfer and McGlashan (48) gave detail compara tes 
to the Terman and Merrill manual for measuring intelligence and i a 
indispensable handbook for beginners. Bochner and Halpern (11) likew s" 
presented the Rorschach test as a method of personality diagnosis se 
included helpful case records and protocols obtained from different e 
of persons. Continued research is needed on interrelations within a E in, 
individual response which help to identify brain injury, sghieaphne ea 
and functioning intelligence; on the validation of the Rorschach meth 


: À : ` Ee se 
by "blind" interpretations and by comparisons with psychiatric pe 
studies; on factors in personality on which the Rorschach method c? 
be expected 


A 3 ‘ shach 
to give evidence; and on sources of errors in the ees 

test (5). A recent development, stimulated by war needs, is the modificati T 

of the Rorschach method for use as a group test (34). Another importa 


H . * n H H a 
development is the Increasing use of projective techniques as part of 
comprehensive study of individuals. 


Synthesis of Data from Comprehensive Sources 


The culmination of fus 


P 5 arch 
ed theory and methodology is found in rese 
in which significant data 


are collected by a variety of appropriate methods 
Ojective as well as psychometric, developmen n 

social case work, medical, observational, im 
sical and Psychological environment—and th 
data are synthesized into 


; ifo! 
a structural personality pattern with “manif 
roots and manifold effects.” 


Several major investigations have d 
of personality research along these 
The Macfarlane “guidance study” 
in the procedure of analysis of dey 
of data and in the interrelations 
Adolescent Growth Study reported 
many-aspect developmental stud 
attention to biological factors, 

The adolescent stud 
Adolescent Study Sta 
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eveloped a methodology in he aat 
synthetic and comprehensive ved 
(56) is making a unique contribu E 
elopmental material within each gro 

among different kinds of data. E 
by Jones (45) is another outstan T 
Y of personality with more than us 


y reported by Brown and other members of He 
ff (14) is exceptional in its being conducted un 
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public-school conditions and in its ingenious charts for synthesizing infor- 
mation about individual pupils—their goals and purposes, their social 
relationships, and the interaction among different aspects of their 
development. 

Burks (18) described in detail her method of studying "identical twins 
reared apart under differing types of family relationships"—a method 
which “seems to offer promise of shedding some light upon the nature of 
traits themselves: their focal character, their variable modes of expression 
and their developmental transformations.” 

This research is an excellent example of insightful analysis and synthesis 
of comprehensive data by means of which “trait organization” or “focus” 
within the individual may be studied. ] 

Although the Harvard Psychological Clinics Explorations in Per- 
sonality (36) was published a year previous to the limits set for this 
review, the reader should be reminded that this research represents the 
most thorough application of previously developed, and of original, sub- 
jective methods to the study of the personality of college students that 
has yet been made. It is the best single source of theoretical interpretation 
of the dynamic, unified approach to the study of "really significant con- 
gtuences in personality.” fr. 

On the preschool level a similar approach has been made by*Lerner 
and Murphy (51). This research is exceptional not only in the develop- 
ment of new projective techniques for use with young children, but 
especially in the interpretation of the children's responses and in the 
focusing of observation on the “why” of their behavior. The experi- 
menters attempted to organize the detailed records into a descriptive 
picture and to formulate hypotheses concerning the child's temperament 
and “foci of emotional drive in terms of conflict, hostility, longing, guilt, 
pleasure, etc.” The hypotheses were then checked in terms of repeated 
evidence from the experiment itself, from subsequent experiments, by 
information from adults, and by further observation and experiments 
designed to test the hypotheses. . j 

Tt is especially significant that this synthetic, comprehensive approach 
is being used in the selection of army officers in England and in Germany. 

e examination, according to an article in the London Times in June 
1942, lasts for two days and includes not only the administration of 
individual tests, but also observation of conduct and attitude in a number 
of practical situations. The life history is considered important and em- 
phasis is placed on qualitative aspects in the study of the total personality. 


Diagnosis of Difficulty in School Subjects 

The trend toward a comprehensive synthetic approach to the study of 
the individual, as already noted, is perceptible in the diagnosis of difficulty 
in school subjects. Olson (61), in his longitudinal growth studies of 
school children, presented reading as an integral part of total growth and 
Cited instances of reading development as an aspect of the growth of the 
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child as a whole. The same concept of reading as “a Emio e e 
growth of the child? was emphasized in the report of the nd edited 
Conference on Reading sponsored by the University of Chicago a Jorat? 
by W. S. Gray (31). Witty (82) likewise has been a p oe Mar 
of the study of the whole individual as a basis for dealing wit dem 
difficulties. His list of diagnostic procedures is therefore bang ique 
of standardized tests, sensory and physiological functions, the : mal 
inventory, diagnostic checklist of pupil’s reading, oe ot 
and home, trait rating scale and reading evaluation, physical an f infor 
data, and home information report. These should yield a wealth iing 
mation for an insightful analysis. The Examiners Diagnostic ce 
Record for High School and College (76) serves as both a guide to pares te 
diagnosis and a convenient form for summarizing the breadth of 1 
mation considered of diagnostic value. Sed 

The concept of doe ation has not yet been as generally statin P 
as the concept of personality patterns. A recent research (75) eet d 
a transition from the statistical analysis of masses of data to the ome 
synthesis of case material in the field of reading. The case studies o eat 
in this investigation focused attention specifically on reading ees 
g case workers employed a procedure “S ible 
wetween the standardized reading-test procedure and the flexi o 
social or psychiatric case study method" (75:5). This combination x 
the interview and tests provided for observation by the examiner aa 
some introspection by the subject as well as quantitative measures 
reading speed, comprehension, and interests. ihs 

Much more emphasis has been placed on the use of tests than on 
whole-child or reading pattern approach for diagnostic purposes. hing 
readiness or prognosis test to detect Weaknesses and to indicate idol B 
emphases necessary to prevent failure has been developed in both the 
of reading and arithmetic. According to Breuckner (16) : 

- the most important fun 


P ic 
: à / : thmet! 
5 ction of readiness tests in both reading and ari 
is not prediction of success i 


where 


stage of development, 
riculum. 


ical 
Other tests of broad and important reading abilities have praes 
diagnostic value. The test of Critical thinking in the social studies ical 
signed for Grades IV, V, and VI by Wrightstone (83), the test of mu 
reading with reference to Problem solving in the intermediate ge 
developed by Gans (26), the test of reading social studies materials in m 
high school by Martin (57), and of the reading of elementary algebr g 
McKim (55), both of the last two tests being based on typical pres 
demands made by their respective subjects—these are examples of t° 


of decided value in the diagnosing of reading difficulties. : sing 
Analysis of errors has long been a common method of diagno 
difficulty in arithmetic and read 


rs 
ing. Bennett (6) analyzed 34,274 Er 
486 


BU 


L. 


December 1942 STUDIES oF INDIVIDUALS 


made by retarded readers in the recognition and pronunciation of 237 
basic words in a contest. She pointed out that errors do not occur in a 
haphazard way. Further advances in individual diagnosis through the 
analysis of errors may be made by studying patterns of errors and relating 
these to other factors such as conditions under which certain combinations 
of errors occur. 

Other approaches to the diagnosis of reading difficulties are through 
the study of separate factors: vision (62), visual fatigue (23), eye- 
movements (29), level of aspiration (38), “organized comparisons be- 
tween meanings" (66), mental ability (59), and reading interests and 
experiences (63). 

Details of diagnostic procedures are supplied by the report by Hildreth 
and Wright (37) of the remedial reading class of eighteen pupils, by 
Preston's (65) case histories of forty pupils referred for remedial work 
after one to nine years of failure in reading, and by Durrell in his book 
Improvement of Basic Reading Abilities (24). 

One of the most valuable diagnostic procedures in spelling is to ascer- 
tain a child's grade level on accepted spelling lists. Betts (7) provided 
such a list of 8,645 words for Grades II to VIII, giving the median grade 
placement, frequency in seventeen spellers, and grade range for each. 
Another spelling scale was published in the same year by Bixl® (8). 
This contains a list of 3,679 words with tables indicating the percentage 
of pupils who can spell each word at each grade level from II to VIII. 

It has been disappointing that more attention has not been given to 
the diagnosis of process such as Brownell (15) developed in arithmetic 
and Joseph Dewey in reading. Such diagnosis requires direct observation 
on the part of the investigator and introspection or verbalization on the 


Part of the child. In this way the mental processes which lead to correct 
Or to incorrect solutions can be ascertained. Two children may have the 


Same score on a reading test but their reading ability may be quite dif- 
ferent because of differences in their methods of work. In the individual 
lesting situation these different patterns of methods of work may be 
diagnosed, for the examiner can ask the subject to explain how he solved 


the problems or did the tasks. 


Significant Developments in Methodology 
of Studying Individuals 
Among the most significant developments in methodology are: n 
l. The inclusion of additional sources of data in the study of an indi- 
vidual—the environmental setting, the situations in which responses are 
made, more use of unstructured and experimental material, observations 
directed toward the “why” of behavior and social interaction, and the in- 


Creased use of personal documents. Ins. : / 
Increased ers of the genetic approach beginning with the young fe 
and working forward rather than beginning with a maladjustment an 


Working backward. 
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ox " re of the 
3. “Insightful” analysis and synthesis into a unitary structu 
comprehensive data collected. . : ; -—. 
4. The search for persistent, pervasive trends in personality th 


x h : urpose, 
fest themselves in specific behavior and are allied to conation, p 
striving. 


A lity, 
5. The cautious approach to any quantitative analysis of gm a 
with the recognition that the attempt at standardization may 
dynamic patterns.” . 
6. The attempt to predict from case study material. ality from 
7. The formulation of hypotheses concerning human persona ale case 
the study of individual cases, recognizing that although the mE | that 
does not discover a law, it does discover that there is a law, & 
therefore the individual case has research importance. "v reflect the 
8. The clearer recognition that appraisals of personality F? hologist 
personality and training of the investigator and that the psy 
must therefore *himself become an instrument of precision. to their 
9. There are individual differences in subjects with ps mh s more 
response to different methods, which may make one appro 
appropriate for one person than for another person. 


er- 
"These trends represent progress in the study of the uniqueness bcd be 
sonalivy and in the diagnosis of maladjustment. They uu rr sub- 
applied to a greater extent in the diagnosis of difficulties in sc of the 
jects. Each trend implies a criticism as well as a commendation 
present status of diagnostic studies of individuals. 
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CHAPTER III 
Survey and Trend Studies 


DAVID SEGEL 


Tus CHAPTER is concerned with studies involving mass data ome 
represent conditions or trends. The treatment is divided into (a) sc a 
surveys—state, city, and community; (b) large-scale testing programs; 
and (c) studies of language. 


General problems of methodology in making status and trend studies 
are discussed by Segel ( 


30) and by the Committee on Educational Re- 
search at the University of Minnesota (21). ! rali 
Sears (28) pointed out that the survey is not itself a definite er e 
technique but is rather the over-all interpretation and synthesis of cue 
discovered through more detailed research techniques. In consider s 
the methodology of the school survey, two aspects should be gc on 
Cone is the application of new techniques found to be useful in gather ` 
data in@urveys, and the other is the general approach to the prob or 
and the synthesis of the results. A survey properly conceived and execute 


E i 1 
is the most comprehensive and at the same time the most valuable of = 
research undertakings, because it deals with the broad aspects of actu? 
field (or life) Situations. 


State School Surveys 


The Regents? Inquiry into the Character and Cost of Public asd 
in the State of New York (1, 6, 10, 11, 17, 20, 25, 26, 32, 33, 39, m 
set up first of all a general objective: to discover any failure of the NOW 
York State school system to meet the needs of youth. This general objective 
was broken down into workable units of inquiry, such as the needs 9 
youth in occupational, civic, or recreational areas. 

The survey did not stop with examining directly the school program 


. n he 
as is customary in school Surveys, but also examined the effect of t 
school on former stude. 


nts and on the out-of-school activities of students. 
Two thousand former students of the high schools of the state of New 
York were interviewed regarding their major problems, attitude — 
their present jobs, source of any advice received in regard to wocauen? 
reading activities, club activities, movie attendance, training being he 
ceived on the job, and hobbies. The information obtained from t ë 
employees was concerned with the initiative shown and other evidenc 
of satisfactory work. The data were considered in relation to the curricu- 
lums that the young people had followed while in school. Through Lom 
type of analysis there was a definite attempt to correlate the condition: 


of school environment with adjustment in later life. 
492 


> 


December 1942 SURVEY AND TREND STUDIES 


This survey exemplifies the following desirable steps: 


1. Setting up objectives of the survey. 

2. Determining the types of investiga 
objectives of the survey. 

3. Gathering primary data through whatever instruments are most pertinent. This 
step involves the investigation of the school and its program, and also of the product 
of the school. 

4. Synthesis: studying the interrelationships of various data gathered. 

5. Formulation of conclusions regarding needed changes in the school system. 


tion which will secure data bearing on the 


s the study by Mort and Cornell (23). 
tation of school practices to changing 
al innovations were the kindergarten, 
lasses, homemaking for boys, adult 
elimination of final examina- 


Another type of state survey i 
This study dealt with the adap 
needs in nine phases of work. Critic 
reorganized high schools, special c 
leisure classes, extracurriculum activities, 
tions, integrated curriculums, and supplementary reading. The degree 
to which these practices existed in the schools of Pennsylvania at different 
points of time were studied through questionnaires sent to all first-, 
second-, and third-class school districts, and a one-tenth random sample 
of the fourth-class districts of the state. The growth throughout the state 
in each adaptation was traced. 9 

An interesting part of this report is a supplement describing thresearch 
methods used in the study. “The authors have attempted to avoid limita- 
tions of particular techniques, methods, and points of view, and have 


moved forward in their study with an effort to make use of such tools 


as best served the field. In our own minds, we feel that we have avoided 
the pitfall of being drawn into polarization of point of view with reference 
to the whole and the part method, the mass descriptive approach versus 
the limited case study upon carefully jsolated factors, or the statistical 


versus the non-quantification approaches. . - - We realized that along 
: P ployed some of doubtful 


with methods of well-established utility we have em 0 

or uncertain reliability and validity. All this was done with the purpose 
in mind of utilizing all tools at hand toward the end of examining $ very 
intricate and dynamic complex, the process of adaptation (p. 435-36). 


City School Surveys 

Both the St. Louis (35) and the Pittsburgh (36) surveys established 
new trends in city surveys through the use of several new techniques in 
getting at civic and social growth in school children. In the St. Louis 
survey, for example, several of the newer tests of social and civic com- 


petence were given. An important comparison was that made between 
mber of semesters of work in the 


the scores on these tests and the nu Á 
various social studies that the pupils had taken. Among the instruments 
used for this purpose were Judgments Characteristic of the Socially Com- 
petent Person; Test of Critical Thinking in the Social Studies; What Do 
You Think? Ordon Social Science Test; and the Melbo Social Science 


Survey Test. 
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An important change in the use of measurement in city P 
illustrated by the Pittsburgh survey. Tests of achievement in a y xd 
such as reading, arithmetic, and English, were not poe in pedem 
because the Research Division of the city schools had cae vun 
tests available in its files which were used by the survey staff. " agents 
took an important step by investigating the extent to which wer aie 
were used by the schools to individualize instruction and provi same | 
vidual guidance. A school survey should not only. prier 
levels of competence but also see if the schools are using all the rachat 
possible to determine individual differences and adapt their ins deus 
and guidance accordingly. An excellent analysis of the research proc 
of the St. Louis survey has been made by Caswell (3). . -— 
Surveys are using new techniques of evaluation but still ped Dus 
general practice of uncontrolled observation of classroom WOT aos 
prehensive school surveys should take advantage of the new instru on 
of general evaluation being evolved for secondary and elementary e caer 
tion, such as those developed by the Cooperative Study of Secon 


EKAR he 

School Standards and those developed in the Research Division of t 
state department of education of New York. . syities | 

_ © The Columbus, Ohio, survey of health and physical education e ol's i 
(12) is à excellent example of a survey of an important area of a scho 


NERA A was 
activities. A new method of getting at the mental health of students v 
tried, thru employing the following criteria: 


1. The child is co; 
age of his classroom 


Pri. 


ia 
nsidered a chronological misfit if his age differs from the medi 
n one year, 


7. A child is regarded 
of the better behavior raj 
sonality Test, 

In order to be 
failed in two or 


as a behavior o 


" is n one 
x T personality problem if he rates low o: 
ling devices, 


s 7 er- 
or. the Personal Index, or the California P 


considered as a m 


r ve 
ental hygiene case the child must ha 
more of these crit 


eria. 
Community (Sociological) Surveys 


In community, or sociological, surve 


" ional 
ys as contrasted with education 
surveys, the problem of ad 
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agricultural village is a town between 250 and 2,500 in population, situated 
Her gie: area, and largely dependent on the farming population for its 
= SATA existence. Since there are approximately 7,000 villages of all 
rid Mi dua population range in the United States it would be an almost 
i pi ssible task to study all the agricultural villages. Jenkins chose for his 
udy the villages used originally by the Institute for Social and Religious 
EA in 1924. These villages were selected by first making a rough 
= de the number of agricultural villages, thus giving the proportion 
sn ages to be selected from each state or region. Within each area 
ilages to be included in the study were selected by sociologists and 
others familiar with the area. Since the sample used was set up in 1924 
a question was raised as to its representativeness in 1938 or 1939. 
Terry and Sims made a cross-section study (37) of all aspects of a 
rural community. The study is largely a detailed and intimate description 
of the life of the community. Whereas in most social studies people are 
interviewed and documentary evidence is examined, in this survey the 
Surveyors actually participated in the life of the community. The com- 
munity was made to feel that the visitors were interested in what the 
community was interested. The writer feels that this method might properly 
be called the “life sample” method since 
samples of time as persons in the community. As an illustration the 
investigation of the religious life of the community may be mentioned. 
€ surveyor attended meetings as a visitor-participant. The church 
activities were in no case cramped by the pressure of the visitor. The 
surveyor sang the songs and took part in the services in the same way 
as any cousin or uncle visiting in the community would do. 
Frederick and Geyer made a community survey at Battle Creek (8). 
he American Council on Education published a guide to community 
Surveys (4). 


egional Testing Programs i 
areas are carried on in a 


Testing programs over wide geographical 25 

Variety of ways and purposes. Some programs use general ability tests 
With high-school freshmen; more often the program consists of achieve- 
ment testing for such purposes as motivation of better scholarship or 
teaching, evaluation of the curriculum, or to provide diagnostic measures 
Or use in remedial instruction. A new emphasis on the guidance aspect 
of Such testing programs is found in the new Iowa undertaking (19). 

is is based on the two following general objectives: d 

nd counselors to keep themselves more in- 


timate] i : i inui d ional development of each 
, nately and reliably acquainted with the continuing educational p cl 
individual pupil, in order that instruction and guidance may be better adapted to his 
Peculiar and changing interests, needs, and abilities; and M i 
n 2. To provide the school administrator with a more dependable and objective basis 
Or the over-all evaluation of the total educational offering of the school, in order that 


ur need for curriculum revision may more surely be brought to his attention, and 
at his supervisory efforts may be more wisely distributed. 


1. To enable teachers, administrators, à 
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The testing program set up to satisfy these two objectives would, ac 


i wing 
ing to the reasoning of the Iowa plan, be one which has the following 
characteristics: 


i: z i t of the 
1, The tests used should measure as directly as possible the attainmen 
ultimate objectives of the entire school program. 


S ES e entire 

2. All the tests should be administered, under standard conditions, to th 

student body. à ] dcc the 
3. The program must provide for the measurement of growth. This means 


le 
EK 2 i omparab 
tests should provide for periodic measurements with the same or with comp: 
tests. 


4. The tests used should mea 
pupils. For this reason it is pla: 
year since no cramming can tal 


in the 
sure the more permanent changes produced of the 
nned to give the Iowa tests at the beginning 


ene ; it is after 8 
ke place for such examinations and since it is 
summer vacation that permanent results of instruction show up best. 


y quie s, Since 
5. The test results should not be usable in the rating of individual teacher 
th 


k 
: ries o chec 
e tests are given at the beginning of the year the results cannot be used t 

on the efficiency of instruction of partieular teachers or classes. 


+. means 
6. The test results should be available in a readily interpretable form. This ™ 


Ó 2 e scores 
that scores from the various tests can easily be compared through comparabl 
or through graphical profiles, 


7. The measures derived 


must be highly comparable from test to test. 
T 8. Each of the tests use: 


dies of 
d must yield highly reliable measures of the abilitie 
the indjyidual pupil. 


The instruments devised fo 
fundamental abilities of 
standing of basic soci 


ing 
r the testing in Iowa cover the dee 
pupils in the Secondary school: (a) the ave 
al concepts, (b) the ability to do ele 
thinking, (c) the ability to write correctly, (d) proficiency in the E lied, 
sciences, (e) the ability to interpret reading materials in the social Bue cess 
(f) the ability to interpret reading materials in the natural scien 


ae E i rtant 
(g) the ability to read literary materials, (h) the ability to use impo 
sources of information, 


or 
and (i) the ability to recognize important d 
meanings. 
The Illinois 1941 State Tes 
gram sponsored by the high 
to aid high schools i i 


a ro- 
ting Program (7) was a cooperative P^: 
schools and colleges of the state of sn 


made available. 


The purpose of state department testing programs has been 


accrediting of school. 


. An example of a new 
Wn by the Examination Division of the state © 
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York is bei 
rs ur © state there is being gradually introduced a new system of 
ihe xn ased on fundamental abilities, such as reading and mathematics. 
t : 
e e: ben ee the schools are encouraged to use in instruction and 
ce. This development in New York is something li i 
ul, daeh, p ing like that in Iowa 


Age-Grade-Progress Studies 


grece segno survey of Los Angeles County (19) made comparisons 
fined grade status for the years 1929, 1933, and 1937. This study com- 
didus 2 terms of percents, normally placed, over-age, and under-age 
The Ne ee three years in the nonurban schools of Los Angeles County. 
peii ork City report for the school year 1940-41 (24) included 
to 196 "e figures of promotion and ages for most of the years 1925 
lee ge-grade-progress for 1940-41 was analyzed at length. The state 
tian ent of education of New York (22) made a study covering the 
pes i of pupils in rural districts from Grade VIII through high school, 
hoe of five years. Some of the broader aspects of the maladjustment 
is en the pupils and the school program were ascertained. This. study 

a trend study based upon two cross sections ma 


five years, 
T a P ade ‘ d 
here is a general weakness in statistics gathered about children in that 


Debes uniformity in the standard set for normal school entrance 

compariso mds grades or periods of school life. This mitigates against 

Office of Ed 9 different geographical or political regions. The U. S. 

encouraei ucation, through its bulletin on age-grade-progress (31), is 
aging the standardization of age-grade-progress data. 


Studies of Language 

as increased considerably during the last few 
e three types of approaches in this field. 
f the logical basis of language as 
^s new book (2) and Korzybski's 
through building up another 
*By a semantical system (for 


A ou ied of language h 
The es n general there appear to be 
3 it c pin of the consideration o 
book (16) meme such as in Carnap: 

. ese authors studied meaning 


ang x EA 
.Aanguage to explain the original language. 


int A 
erpreted system), we understand a system of rules formulated in a 
language, of such a kind that the 


ee and referring to an object : 
ao (sn a truth-condition for every sentence of the object language, 
d s icient and necessary condition for its truth. ' Carnap has expanded 
eee the *metalanguage" suggested by Korzybski and has set up 
Staten e rules for using this language analyzing declarative English 
ments. The metalanguage is a combination of symbols and English. 

hat illustrated by Fries 


Another ‘approach to the study of language is t 
found in 3,000 letters of a 


9) w f 
(9) who studied intensively the languase 
assified the writers into three 


fe 
ees government department. He first cl 
ial or class groups in accord with definite information including the 
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3 ial con- 
education and occupation of the writers and in some cases a Teu 
fidential report on the family. The language facts for a t ve AE 
of persons were examined for forms of words, the uses of s Piden anon 
or the uses of word order. Upon the basis of his study, 
mended a new type of approach in the teaching of quy — 

The third type of language study is the statistical stu Ta Awd that 
rence of word meaning or of errors of language. Davis (5) i only be 
in counting errors in oral speech, the amount of such — er amount 
judged if the relative amount of error can be compared wit phe 
of correct speech. Davis made this comparison by taking actua bey 
tions of the speech of a large number of children. Those sig ), which 
counts should read Thorndike's analysis of word counts (3 * oie 
discusses the results of various types of approach. Knott Eel Td (27) 
somewhat the same problem, as did also Seegers (29). Rinslan Grades 
studied the words from 100,212 separate writings of children in eir 
I through VIII. The words were analyzed for the different e WE 
There are two weaknesses in the method: (a) Children hesitate they’ use 
Words.they cannot spell and may therefore leave out words ds they 
s children use may not necessarily be the wor 


à 34) 
should 3se or the words that they should know when reading. Stone ( 
studied vocabulary based on 


H re- 
children’s words and Horn (13) reviewed 
search on adult vocabularies. 
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CHAPTER IV 


Experimental and Statistical Studies: 
Applications of Newer Statistical Techniques" 


PAUL BLOMMERS and E. F. LINDQUIST 


Tae tasr rew YEARS have witnessed a gradual and rather belated intro- 
ines o research procedures in education of the many new and in 
dutie tha very important statistical techniques that have become available 
plications ia. two or three decades. While many of the educational ap- 
diced a dent ese newer techniques have been valid, not a few have evi- 
fhe implikat ty understanding of the techniques ora failure to recognize 
lia. Tr ie of the theoretical assumptions underlying their deriva- 
thes, aca e purpose of this chapter to attempt a general appraisal of 
theref pplications from the technician's point of view. The chapter has 
h efore been organized wit 
mee cited with referen 
TEA ei important prevalent errors and misco 
of insi Ke va id applications. In some of the studies cited the er 
foe y minor consequence and in all other respects the 
The tre n conducted. 
er is xev is divided into three genera 
anda eae ving correlation, significance o 
alysis of variance and covariance. 


ce to each technique as were neededjjo yiel 
misconceptions, OT, occa- 
ror may be 


study may 


], somewhat overlapping areas: 
f differences between means, 


Signi 
ignificance or Reliability of an Obtained Correlation Coefficient 
or reliability of an obtained 


kers in education. Four in- 
plication of the Fisher z-transformation 
null hypothesis. While the z-function 


othesis, the F-test 


ng the significance 


Newer techniques for testi 
research wor 


iat been largely ignored by 
iis ces were noted in which this ap 
a (6, 12, 33, 55) to test the 

es a satisfactory test of this hyp 

7 N 
F-ü0- ix —2) 

ive measure of the signifi- 
f the F-test was observed. 
s employed to establish 
for obtained cor- 


act and conservat 
pplication [ 
formation wa 
(fiducial limits) 


TE a somewhat more ex 
Do. Eh obtained r. No such a 
de instance (18) the z-trans 

percent-level confidence interval 


elias 
elation coefficients 
ME e 1 
2 
F 
or other reviews of statistical methods see Chapters VII and VIII of this issue. 
501 


h reference to techniques. Only as many mdi e 
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Averaging Correlation Coefficients 


The Fisher z-transformation makes it possible to obtain un impu 
estimate of the population correlation by pooling estimates of t i : see 
tion based on several independent random samples drawn from wc Ds. 
lation. Four applications of this procedure were encountered ( A 5n 
33, 40). For this procedure to be valid the estimates averaged yu e 
based on random samples from the same population (or equally eae 
lated populations). In some instances the technique concerned yar e 
employed without regard to this condition. Rizzo (40) obtained inte! lied 
relations for scores yielded by three different scoring procedures app 1 
to three different tests for each of eight different grade levels. As ne 
as could be told from the data presented, at least half of the diferenca 
in the intercorrelations thus obtained were significant. Yet Rizzo not ird 
used the z technique to pool correlations for different techniques W1 id 
a given grade-level and for different grade-levels within a given Pas 
technique, but also for all grades and all testing techniques. A sim! 


à izzo 
error was made in the second part of the study. It would appear that R 


5 A š g ing 0: 
has incorrectly assumed that the z technique permits the averagws 
correlation coefficients ir 


A * i nces 
general, without regard to possible real differe 
"^ Übetween, them. 


McCénnell (25) employed the z-transformation to average the vu 
correlations between scores on the major subjectmatter subdivisions (p ie 
ics, acoustics and astronomy, and chemistry) of a comprehensive pnma 
tion in physical science. He also averaged the intercorrelations between the 
scores on the various “outcome” parts (vocabulary, knowledge of facts m 
principles, application of facts and principles) of this same examinat! i 

is procedure would be valid if one could assume that the correlation 


: z han 
averaged were obtained from independent random samples rather E 


= ions 
from the same sample, and if one could assume also that these correlat 
were all estimates of th 


ions 
€ same value. However, neither of these assumptio? 
seems reasonable and the procedure js open to question. ol 
Lannholm (21) reported strong evidence of real differences from E 
to school in reliability coefficients and also in validity coefficients for 
same test. However. 


: A involveds 
: verage the coefficients for the various schools invo 
commenting: 


. es 
Since this method of averaging correlation values is not valid if true different 
in correlation exist from one school to the other, the use of this procedure P ned 
questionable in this case, Nevertheless, it is believed that the averages thus obt 
represent perhaps the best possible estimate of the general validity of each 9 
different tests (p. 70). 


«ants 

The Significance of a Difference between Correlation Coefficie? 
The Fisher z- 
(3, 26, 29, 48 
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$ dies 
transformation was properly applied in a number of vers 
>» 92, 58) to test the significance of a difference be 


» 
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Po A picis obtained from independent. random samples. In 
related iini owever (4, 13, 25), this test was incorrectly applied to 
sud VM coefficients obtained from the same sample. Edgerton 
Uu ime "n fora sample of 288 men, obtained the six correlations 
LR anus a iberalism score and separate liberalism scores in democ- 
SUC six a relations, labor, race, nationalism, and militarism. The 
these ES ect cape were obtained for 149 women. Sex differences in 
the samples nships were then tested by the Fisher z-test. In this application 
These 4 IS apparently independent and, if random, the test is valid. 

mena writers, however, go further. They present 129 correlations for 
coffidtent s that hence there are 8,256 possible differences in correlation 
arene or men alone. Since it was not feasible to test each of these 
PEN aen individually, the writers provided a table containing the signifi- 
288 dog aae iig: 2) for differences between r's based on samples of 
can edition ey. then suggest that by means of this table “. . - the reader 
Which he ate the significance of the difference between any correlations 
ables in à Ton to compare in this study (P 262) . Inasmuch as the vari- 
the sam volved are related and all correlation coefficients are derived from 
to EE. sample, none of the tests of significance that a reader might choose 
corral $ by means of this table would be valid.? Even though alljthese 

elation coefficients had been obtained from independent random sam- 


jl T 
The ws mass procedure suggested in this study would still not be valid. 
allacy involved in effecting such tests en masse may be appreciated 
independent 


y noti E : 
Reapers that if the 129 correlations were derived from 1 e 
of th m samples drawn from the same population (i. e., all estimates 
t Eon same value), some 400 of the 8,256 possible differences between 
would be judged “significant” according to this procedure. 
Sieni ; 
ignificance of a Difference Involving Spearman-Brown Estimates 
em of the studies cited in the preceding section have been concerned 
thithe validity of the Spearman-Brown formula for predicting reliability 
1 ficients under circumstances somewhat different from those for which 
oe was originally intended. Bruce (4), for example, obtained the 
or € point averages of 209 students who remained in college attendance 
poi; twelve consecutive quarters. She estimated the reliability of the grade 
Pee averages by correlating those earned by each student in two consecu- 
E From this r the reliability of grade point averages over n quar- 
aaa yp ot 5 relation coate 
is tes of which hav. i has been derive 
a rim i 


Ca — T) N 3v t — ,df=N-3- 


ce 

VEA — r TA E Ore Tn Te 
4. See H. Hotelling, “The Selection of Variates 
x, See on of Nuisance Parameters.” Annals of 


jents of the type yt 


d by W. G. Cochran. 


f the significance of the difference between related © 
same sample, 


An 


equi 
for (tivalent test was independently derived by Hotellin: 


Ise vat 
thema Prediction with Some Comments on the Gener 
ical Statistics, 1940, Vol. 11, PP- 271-83. 
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: ta 
ters was predicted by means of the Spearman-Brown formula. Since wars = 
were available for the direct computation of the reliability over n qu dor d 
the obtained r for n quarters was compared with the predicted i icy 
quarters by means of the z-test. This application of the z-test is not s Sil 
valid because the predicted r and the obtained r are not here indepen 


: A r esting 
Bruce was aware of this shortcoming and tried other methods of testing 
the difference concerned. 


test 


that 
ti e 
Tesponses from two to five it is conclud h 


ti 
letely support the hypothesis” (p. 704) sated 
€ established the hypothesis, they have i es 
i statistical logic. No null hypothesis ca" 
tablished on the basis of results from random samples. The samp <pilit 
may be consistent with the j 


null hypothesis and may establish its ten 
do not 
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Intraclass Correlation 


( Not eae of intraclass correlation techniques were encountered 
(34) ahar E which were concerned with the study of twins. Portenier 
Tihe a ee twelve pairs of twins with twelve pairs of siblings on a 
SERE R personality measures. For each of these measures the intraclass 
Mia imm : were obtained for the twins and for the siblings. These r's 
hs ie e iege into z's and the differences between these Z's for the 
8 En he corresponding z's for the siblings were tested for significance. 
the standard error of these z's the author used the formula 


tI ub 
==> . This is actually the formula for the standard error of a z 


(oO Vn=3 
arisi r 
Ising from an interclass r, the proper formula for the S.E. of a z 


arisi : . 1 
ising from an intraclass r being a me . It should be noted that 
ws 


G, 


rmula Portenier erred on the conservative side. Re- 
of the differences obtained Portenier stated that 


"iin of the significance ratios exceeded 2.0, but that if any ratio greater 
etd is acceptable, certain of the differences are significant. This last 
Erm is approximately equivalent to accepting the 32 percent- vel of 
ence as a criterion of significance, which is contrary to all practice. 
of Paire | important point to be noted is that because of the small number 
z's Gana (12 pairs) any demonstration of real differences between 
that d pide taken as the critical value of the significance ratio) requires 
the web, tained difference be as great as .72. This condition illustrates 
ences þ ity of attempting to demonstrate the presence of small real differ- 
S between correlation coefficients derived from small samples (21a). 
in organ (28) obtained certain measures of eye-movement performance 
Yeading for a sample of artificial twin pairs, a sample of fraternal twin 
Tw and a sample of identical twin pairs. The intraclass coefficients of 
t relation were reported for each of the three types of pairs on each of 
Bose n ameni; taken. The manner of computing the P.E. of the obtained 
e Clents was not reported' and, although the necessary data were given, 
val Writers were unable to duplicate certain of Morgan s reported PE. 
ues. The P.E. of the distribution of obtained intraclass r's about the 
t 5 Jy 
Tue coefficient, p, is ordinarily given by P.E.,= 6745 VN when the 


ñumber in each class is 2 and when N is sufficiently large. This formula 


is lim; y 
limited not only by the fact that it involves a population parameter but 
ined r's about p becomes in- 


wae e fact that the distribution of obtain M Ws 

Were ed skewed as r approaches +1.00. Since a of the ds oe 

me considerable size, this study illustrates an application of the P.E. 

ied is often virtually meaningless but which unfortunately is common 
Ucational research. 


in using the im 
i proper fo 
Barding the reliability 
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.. ets 
Correlation Coefficients from Relatively Homogeneous Subs 


" that 

When a bivariate population is comprised of subpopulations cl 
the subpopulations are more homogeneous with reference to on bum 
variables than the total population, and such that the e meae We. 
the variates is the same for all subpopulations, then, on the basis - ene 
samples (groups) drawn from the various subpopulations, a a moiligds 
of the common *within group" correlation may be obtained by the roperly 
of analysis of covariance. Osborn (30) employed this procedure iia = 
to estimate a number of correlation coefficients, such as those ard d 
performance on an achievement test and the shift in Mae D 
certain social issue resulting from a propagandizing treatment. His su er 
consisted of the members of intact class groups selected from dne 
systems. On the grounds that attitude toward the issue concerne nen 
to be less varied within a school community than in the total TP oi A 
of school children, a given school may be regarded as a sapi rmulas 
relatively homogeneous subpopulation. Hence, Osborn used the S his 
of analysis of covariance to obtain the “within class” correlations, 


TO : ifferences 
eliminating from the coefficients whatever effect between-school diff 
) © may have had upon them. 


Kuder-Richardson Reliability Formulas 


ormula (20). Froehlich (16) ani 
he Kuder-Richardson Formula J] the 
part on the assumption that h em 
form difficulty. Froehlich made a toupa t 
ality of this assumption by Sig ere H 
in Achievement Test to 2,000 individuals. 
efficients for each of the five-part scores 4 rdson 
split-halves procedure and the Kuder-Richarc? 
Formula (21). The diffic ‘ 


; i - t dif 
reliability were relatively slight, the larges 
ference being .058. Moreover the two indexes correlated perfectly. ar 
The Kuder-Richards 


"YN s taine 
is difficult to say what it is that the 7’s thus ob “j 
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nag the Significance of the Difference between 
eans of Independent Random Samples 


SEDE. of the t distribution (students’ distribution) to test the 
p acre à the difference between means of independent random 
54, 57 S9). E increasingly common (1, 6, 14, 15, 27, 32, 35, 
dilsrence b intner (32) made extensive use of the t-test in studying the 
— p etween normal hearing and hard-of-hearing individuals of 
The mr eas with respect to certain measures of personality traits. 
of vas E M ich he thus compared were based on independent samples 
that = dE. On the whole his samples were large, so large in fact 
pw Ban instances it was necessary to enter the t-table for an in- 
Banal; arge Sumber of degrees of freedom. As a consequence the tradi- 
Test mal would in theory have been somewhat superior to the 
former EN the latter assumes homogeneity of variance whereas the 
oes not. 

"scum to Fisher (14a) the value of t yielded by the latter test tends 
D es to be increased by a difference in variance between the popula- 
Hore E3 which the sample is drawn. It would be well to distinguish 
Aeri y between these two tests and bet 
lage ng their use. The traditional test is generally to be prefeled for 
“ae a for small samples the t-test must be used. A particularly 
m bene is that of employing the traditional procedure with small 
it were Ao interpreting the significance ratio thus obtained as though 
cerns e t statistic. Wolfe (57), for example, used the traditional pro- 
group e) comparing a small group of average readers with a small 
audition retarded readers with reference to such factors as laterality, 
critical aN verbal association, and adjustment. She interpreted the 

ratios thus obtained as (’s, entering the t-table for seventeen degrees 


o! freedom, Wolfe dealt with equal sized groups, in which special case 
However, the proper 


t 
ee yield identical significance ratios. D 
the er of degrees of freedom is thirty-four rather than seventeen, since 
groups compared each involved eighteen. subjects. It is less likely 
mula for ¢ been 


that th; 
this error would have occurred had the proper fori 
CENE I MET aa 
rs, de a s 
‘t= M,— 
M , where gi = variance of sample 1. 


Juara, nN 
N+N,-2 NN, 


—4, Here F=8.01 whereas 
d frequencies, the value of 
es as great as that of the 


if esto] = esto} the two 
i 


u 
Sen for example, that Ni= 500, N2= 1000, si =32, and S 
* based on With this large difference between both the sample variances an 
Significance these samples and for any difference in meaty will be 1.373 tim! 
Procedures grt’ yielded by the traditional procedure. On the other hand 
es yield identical results regardless of the difference between N, and Ny 
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ree em- 

employed. Another instance in which the traditional D ag 
ployed and interpreted as t was found in a study y s beso WEE 
again, however, the groups upon which the comparison 
equal in size and hence the results are valid. . — e 

The application of an estimate of error designed for use in unii 
pendent samples leads to biased results when applied to i^i, npe nes 
are not independent. Researchers working with paired samp i. M ee 
erally taken this fact into account. However, it has frequently éd a 
by workers dealing with groups which have been equated wi Hd dedii 
to some control variable by simply making the means and standar rien 
tions approximately equal for the two groups. Young (59), poor Pn 
relative effectiveness of different lengths of practice periods, Ed The 
three procedures with reference to four phases of school Terie 
twenty-three subjects which comprised each of the three pe initial 
groups were closely matched with respect to age, intelligence, an m 
ability in the particular phase of learning being considered. Young test 
that the significance of the difference between group means ir eave 
by the t-test. Recomputation of the reported probabilities of the t's 0 A n 
for various differences between means showed that the t-test employe 


8 is not 
that de? gned for use with independent samples. This particular test ! 
appropriate here. 


Testing the Significance of the Difference between 
Means of Paired Measures 


en 
Applications of the t-test of the significance of the difference etw? 
means of paired measures are not common in the field of education foun 
24, 25, 30). A particularly interesting application of this t-test he the 
in a study by Osborn (30). Osborn sought to determine ne less 
change in attitude toward a certain social issue was significant E y 
for individuals who had been taught to be on guard against aee e tac 
niques of propaganda. Osborn’s subjects were the members o shoo 
classes of school pupils selected from a number of schools, Each em nt” 
yielded two classes, one of which was used as an experimental or 2 zou 
group and the other of which was used as the control or “untaught™ & 


: treat- 
Osborn reasoned that, apart from the effects of the experimenta i 
ment, the pupils in a single school 


would be relatively homogeneo, y 
their attitude toward the issue concerned, and that hence the whole go 
had to be regarded as a sample of schools rather than as a om aer 
pupils. His analysis was therefore concerned with class means P roxi- 
than with individual measures, Since the classes all involved co 
mately the same number of individuals the unweighted means were eac! 
These means were paired by schools and the difference found for was 
school. The t-test for a difference between means of paired measure? 
then appropriately used to test the significance of these difference? 
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Simple Analysis of Variance 
in terms, it may be well first to 


So that there may be no confusion 
ple analysis of variance.” Given a 


e ppm what we mean by “sim 
PRSA sir i which may be classified into groups, the sum of the 
C aa leviations of all observations from their general mean may be 
of "lt into two components. One of these is the sum (for all groups) 
ctum pe deviations of the observations from their respective group 
Bim , the other is the weighted sum of the squared deviations of the 
b p means from the general mean. Each of these components, divided 

y the appropriate degrees of freedom, will yield an unbiased estimate of 
a population variance, on the assumption that all groups were inde- 
aur drawn at random from equally variable populations. On the 
dnd: assumption that in these populations the observations are normally 
to o one may use the F-ratio between these two estimates of variance 
in sons e hypothesis that the population means are equal. Any instance 
m ich a test of this type is based on an analysis of variance into two 
of = will here be referred to as an instance of simple analysis 
äi iris n as distinguished from the more complex case m which the 

alysis divides into several components. e 
E and Donnelly (51) compared the scores made four €: previ- 
Ee len various aptitude and entrance proficiency t 
grgüped an from college. In one phase of this study. 
groups measures of mathematical aptitude for these in 
the b eere to the major field subsequently 
the Po s of simple analysis of variance to test t 
times p means were equal. This analysis. : 
once Tor th for each of the three other aptitudes or ski 
assum or the composite of the four measures. Except for the 35 
iei im of normality was not satisfied—an assumption which 1 

y not crucial—this application seems sound. 

Pdgerton and others (13), Evans and Wren (14), Mellens Col and 
rel CHAR and Bordin (56) employed analysis of variance Y en p 
ae techniques would have been more appropriate. ‘ m a 
Scores (14) placed 148 students into four groups on the basis 0 is 
es. The grade point averages for these individuals were analyzed so 


as to yield a “between groups" variance and a “within group” variance. 
ges of these groups varied 


s values for both variables, 
the data in order to use the 
in general, are more ap- 


and 
Yet coarse categories were 
heme of correla- 


me! 

rent ka analysis of variance. Such data, 
priately analyzed b lati roce 

i yzed by correlation P a 1 

tion analysis based on Y to unbiased correlation ratio set forth by Peters 


NE VanVoorhis (31a)—the so-called Epsilon technique—is admirably 
dad to the analysis of data of this type. The Epsilon technique has 
€ advantage of not only providing a test of significance equivalent to 
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— ily inter- 
that provided in analysis of variance, but also providing a na ex 
pretable estimate of the strength of the relationship. Where the assump 


i i ion serves 
of linearity seems justified the ordinary product-moment correlation 
the same purpose. 


Significant and the 


de- 
€" the finer categories would ordinarily be considered the more 
pendabl®}For similar re. 


concerned, but that they 
tional age means were c 
rather interesting error, 
a “within class” varianc 
2.56. Obviously, the m. 
differ significantl 


‘ance: 
he “between classes" varia son, 
is smaller than the error variance (the “within class" variance). Lam 


+ ance 
ratio using the “between classes” esc 
Tm and concluded that: “. . . the varia ine 
© expected in similar samplings ninety-” up 
result of chance factors. The composite gr^ 
erence to intellectual ability” (p. 177) lie 
dly have been drawn from this F -test app ces 
al factor had operated to make the differen ce. 
derably smaller than would result by ns 
Í simple analysis of variance to experime? 

9 Part V was done by W. A. B. Schrader. 
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data w > 

sod renee e in the educational periodicals checked. Lohmeyer 

Xiethods of s were concerned with the relative effectiveness of three 

A E mul 2 pesenna A pre-test was given over the material 

AA d un methods groups were equated in part with refer- 

| mieu: p his same test was used again as a final or post- 
, the criterion measures analyzed being the differences be- 


twee x 

for ia cops pre-test and post-test scores. No allowance was made 

affords a defi ed T groups, hence a simple analysis in this case 

presentation = ely biased test of the hypothesis that the methods of 

available e equally effective. Since the preliminary measures were 
, an analysis of covariance might have provided an unbiased 


test of this hypothesis. 


The 

t- " 

eee Used in Conjunction with an 
of Variance or of Covariance 


Som i 
eti i ; , s R. 
mes, in a simple analysis of variance of a sample consisting of 
:enificance of the difference between 


Several PRA 
groups, it is desired to test the signi 
l, it is defensible 


the me 
to use "he of a particular pair of these groups In genera 
e t-test for this purpose only after the F-ratio of the "between 
indicates that taken join@y the 


roups” 
hot and "within groups" variances 
bin. the te differ significantly. The research worker should guard 
ticularly a temptation to apply the t-test to certain pairs of means (par- 
when the P selected because they show a relatively large difference) 
Means is -test has already shown that the observed variation 1n the 
study by 1o attributable to chance. This mistake was made in a 
ren (14) u in-Rabson (42). Long and Welch (23) and Evans and 
the ver: E applied the t-test to selected pairs of means before applying 
may be fo F-test. A valid application of the ż-test ın such situations 
the Meee in a study by Lohmeyer and Ojemann (22). An example of 
may be f properly applied in conjunction with an analysis of covariance 
pre ound in Spencer's study (50) dealing with the retention of orally 
sented materials. 
nce 


Com 
plex Applications of Analysis of Varia 
ee components is found in a study by 


ast " à . 
St (7), which was concerned with the problem of evaluating different 


meth, f 
ods of marking themes. Cast submitted forty themes to twelve judges 
he same prescribed method. Cast 


each 
vite m marked each theme by t p: | 
an estimat ree independent estimates of the population variance, namely, 
Upon V 5 based on the differences between themes (P). an estimate based 
Tesidu 1 differences between judges (Ve): and an estimate based on the 
ue ia or remaining differences between tae 0 x 12 ratings after effects 
that T themes and judges had been eliminated (Vr). Reasoning, then, 
system of marking which did not differentiate significantly between 
F=V./V; is one 


em, P 
“Temes was valueless, Cast concluded that a significant 
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at a good 
of the criteria of a good marking technique. He next ud © er 
marking system does not differentiate between La Gn peal Finally 
cant F = V/V, would be indicative of a poor mar ma des render 
Cast reasoned that a good marking system is one whic Y eT V tai 
errors to a minimum, and that, therefore, a significant es ies 
where V tora. is obtained by dividing the total sums of squares 2 ie esl 
degrees of freedom, would indicate a poor —— ah variances 
step he made an error—that of trying to test an F-ratio betw 
that are not independent of one another. 


cing using 
Cast repeated this analysis with three other schemes of sacar two 
the same themes and the same judges, a period of apprenne ond on 
months separating each marking. He ranked the schemes thus s in pro- 
the basis of the three F-ratios described—a somewhat quelin of the 
cedure in view of the lack of any evidence of the comparabi ds may 
F’s or of the reliability of the ranking. A similar form of analy 
be found in a study by Sells, Loftus, and Herbert (49). 


; s inter 
A study by Owens (31) of intra-individual differences versu 
individual differences in 


sty 0 

ns variety | 
motor skills illustrates an unusual e of which 

appligations of analysis of variance and other techniques, som! 

seem “ds questionable as the 


: gas 
y are ingenious and interesting. Mr 
ministered each of six tests of motor skills eight times to € 
individuals, in an effort to determine the relative magnitude o «ferences 
ferences from trait to trait within the same individual and (b) di thing? 
Írom individual to individual for the same trait. Among other dminis 
he analyzed the variance (T.V.) of scores obtained from seven 467 . 


» 

n 

3 Is inistrallo' 
trations of a test of a motor skill into the “between admi comp?” 
(R.V.), “between individuals” (I.D.), and “remainder” (error 
nents, and then indicated 


ea 
à jbution 9 

In terms of percents the ami, et that 
factor to the total variance. In his Table 1, for instance, he 


es 
; ifferen 
68 percent of the variance in *block packing" scores is due to di ation 
between individuals, 16 Percent to differences between adminis 


a 
s ces W 
and 16 percent to error, The contribution of individual differen the 
apparently obtained 


rom 
by deducting the error mean square th 
mean square for individ 


fteen 
dif- 


The contribution of administrations we nini™ 

sumably found by deducting the error mean square from a : m 
i d dividing the result by the number o 

ot state specifically what divisor was use nare 9? 
umably then added to the error mE pa only 
ercent of this total, This procedure a » ctor 
) to evaluate the contributions of aec y 
find rather wide applications in educatio Ls 


é o 
: mate 0 
er of categories, however, a percent esti reted to 


contributions were pres 
each expressed as a p 
used in genetics (49a 
to variance, and may 
based on a small numb 


kind is likely to be highly unreliable and should not be interP 
literally. 
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P 


kepada zc a pig me perom GE gt individual 
Pea al variance for each of the six tests, an 1 en averaged 
" divis a to get an over-all measure of the relative importance of 
| E lifferences.. He similarly analyzed the variance of the scores 
(T.D.) E in all administrations for each individual into | ‘between tests” 
individu i etween administrations" (R.V.). and error, and for each 
tostie € Toc esami asa percent the contribution of trait differences 
' an peaking a variance involved. He then averaged these percents to secure 
dee varo measure of the relative importance of trait differences. He 
m ested the significance of the difference between these mean per- 
t tages and concluded, because the difference was not significant, that 
M pie and individual differences are of the same magnitude. One 
RR conclude, however, that because trait variations and individual 
e an represent equal proportions of different things, that they are 
E en re equal to one another. Individual differences were expressed as 
eLa E of individual differences plus administration differences plus 
- Trait differences were expressed as a percent of trait differences 
p administration differences plus error. No explanation is given of 
ow these sums can be considered to represent the same total variance 

i (apparently one would have to assume that which is to be proved, i. e. « 
that trait variations are equal to individual variations), while the#igures 


given show definitely that they are not equal. ind 


To summarize the analyses of the type first described, Owens t 
from the separate analyses 


E of squares and degrees of freedom | i bie 
78 fone rs to secure a table (Table 8) in vp xb 
or Q m ks for between rette an » aad zd 
of freed na in E 3 (repention . How 0 le. cal er DE a 
individ om for “between individuals” in an analysis involving E y 

obt viduals or how on any consistent basis the 72 degrees of free ya 
t re a for differences between administrations, are other Quod al 
J quire explanation. Owens similarly summarized (Table 9) the ata 
9r the second type of analysis for the fifteen individuals. and in each 
qummary table applied an F-test on the basis of the degrees of freedom 


thus obtained. 

It should be noted that even though the percents obtained were com- 
porubl from the two summary tables, one may not conclude from a non- 
'gnificant difference that trait differences and individual differences are 
i the same magnitude. To do so is to make the common mistake pr 
empting to prove a null hypothesis. Owens is guilty of this latter mistake 
at another point also when having tested the homogeneity of a number of 
variances, he says (p. 309) that, "In all cases, the value of L failed to 
Teach over the 5 percent-level, which means that the variances within groups 


are the » 
same" (p. 309). í 
4 Owens? study involved several other complex procedures sig ee 
space limitations, cannot be discussed here. On the whole, his study is 
l to criticism because of inadequate 


Commendable for ingenuity but is open 
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B m 
reporting of procedures and questions of technical logic. It e 
advisable that educational research workers feel their way slow Be E 
coming acquainted with the possibilities of analysis of inier Ec 
be content for a while with relatively straightforward interpretatio 
relatively simple applications. . — 
edu Wren (14) stated that they applied *. . . analysis of = 
technique with two criteria of classification, Thinking LE (ME on m 
Extroversion) and Miller Analogies scores . . ." (p. 51). ee: 
studied was scholastic achievement. Four classes were formed M A 
erence to each variable by dividing the distribution of scores into d 
Aside from the fact that partial correlation techniques might have Sess: 
more appropriate, this study is cited because of the apparent ere 
ness of one of the tests applied. On page 51, Evans and Wren i :édi 
"When the variance within the Analogies . . . groups was consi M pen 
there was insufficient evidence to determine any difference in the e. : jr 
achievement of the four Thinking LE . . . groups." This is po 3 LE 
the reviewers to mean that the significance of the “between Thinking 


c ithin Miller 
uarters” mean square was tested with reference to the “within s 
eo q i her illustrate 
c Analogies quarters? mean square by the F-test. This further 
the te 


in an 
nsjency to give inadequate consideration to the terms used um a” 
F-test. 'the denominator in all such tests must be meaningful as an Bes 
term with reference to the numerator—the hypothesis tested € xc 
hypothesis that the numerator variánce is entirely attributable to cha 


fluctuations of the type measured by the denominator. 
Gabel's study (17 


definite and indefinite 
tention of social studies 
subjects were the pupil 
systems. The total sum 


d re 


. H i n 
quantitative terms upon comprehension 4 The 


say a 3 is. 
material, illustrates a higher order analys schoo 
s in four grades in each of nine different M 
of s 


ssible 
ades," “between schools,” and all po 


e; Was 

: only effect tested for significance een 

the “between modes of Presentation” effect, all other effects having ba 
determined for the sole Purpose of eliminating them from the error 


degree of abstractness,” and d use 
of antecedents,” They obtained all possible interaction terms anc. an 
error term. Both Ek op ocn in 
d found to be significant. tested 


potency of these two factors, they 
the F-ratio between the “abstrac 


É Since 
tness" and “antecedents” yan anen E 
for both variances this may have served a P ly in- 
purpose in this particular case; this procedure, however, is genere rious 
valid. A means of estimating the relative contributions of the 
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gie to the total variance which may be used when an appropriate 
5s r term is available is that described in the preceding discussion of 
vire) by Owens. 

ieee applied the Graeco-Latin square design in a series of seven 
aon. I2, 43, 44, 45, 46, 47) dealing with memorization of piano 
E ea second study, which is typical of this series, was concerned with 
Hom ey of massed and distributed practice. Nine subjects, nine selec- 

> hree methods were involved. Each subject memorized the nine 


selections, each of the three methods being used for a different set of three 
*3 x 3” Graeco-Latin squares, Rubin-Rabson 
Il nine subjects and at the same 
ncing of the method 


See By means of nine 

p the three method sequences for a 

Nod anced the compositions. Obviously the bala 
IN ces served also to balance the methods. 

dae advantage in such situations of the Latin or Graeco-Latin square 

id 15 that they permit the use of a method of analysis of variance, 

ih recognizes by reducing the error term that the counterbalancing 
creases the precision. (Research workers using other counterbalanced 

` esigns have often incorrectly analyzed the results just as if simple random 

ampling techniques had been employed.) This advantage, however, 1s nte < 


obtained without a price. The balancing of certain of the varias pre- 
some of which may be of 


ules me determination of interaction effects, mar Mk 
nique ch interest as the main effects themselves. Hence, the use of E E 
= digiti n the assumption that there are no real ua. e s 
discussi d other more complex assumptions. In terms of the stu uo ler 
or o SOR this is tantamount to assuming that whatever method works d 
Wolke b selection works best for all selections, or that whatever io o 
select est for one subject works best for all subjects, or E w pU 
readi on is most readily learned by one subject is also the selection mos 
adily learned by the other subjects. It seems unreasonable to suppose 
articular situation, al- 


the H H H 
| at such assumptions are closely satisfied in this p. 
net so that a pooled error term may 


though they: ma 

ay be nearly enough n 5 

S adequately for Re test of the main effects. Before adopting the 

y dus or Graeco-Latin square designs; therefore, research Eu n 

E n should consider carefully the assumption implied, dr p A 

Z vats real interactions, and should consider also the possibi ity of using 
d ctorial design that will permit an evaluation of possible interactions. 

A ubin-Rabson, apparently employing a procedure similar to that used by 

: ens, obtained an estimate of the potency of each variable in terms of 

Percent of the tota] variability, and placed considerable emphasis upon 


5 estimate in interpreting her findings. It should be noted that such a 
3 te error term 18 used. It is 


pr d 
CAE is valid only when an appropria 3 
u btful that the error term yielded from the data as they are arrange 

Sm; in-Rabson’s design is appropriate for this purpose. Certainly with the 

2 numbers of categories employed, these percent estimates are highly 


nrc 
reliable and should be cautiously interpreted. 
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A word should also be said relative to a variation introduced by de 
Rabson in the fourth study of this series (44), in which the methods p $ 
not rotated but were presented to all subjects in the same grim E 
was really done, the “order” differences would be inextricably mixe : 
“confounded” with the “methods” differences. Rubin-Rabson apparen d 
was not aware of this fact, since in analyzing her data she somehow n 
tained separate sums of squares for “methods” and for “order. ape it 
ently she obtained the same sum of squares twice, in one case gun 
the “methods” sum of squares and in the other the “order” or ' qM 
sum of squares. If this is a correct interpretation of her statements, d 
thus deducted the intermingled effects of “methods” and “order” from t 
residual or error term not once but twice. 


Studies Employing Analysis of Covariance 


Most research workers in education are familiar with the “snatched 
groups” type of experiment and are aware of the administrative mie 
involved in attempts to match groups of school pupils. Since the m oe 

^ (pf analysis of covariance offers a way of securing the same degree © P 
cision (Jithout the administrative inconveniences of matching, it is $ a 
prising that this technique has not been more widely adopted by educ d 
tional research workers. However, the reviewers were able to find only 0” 
published study in which this procedure had been employed. This is a stu es 
by Spencer (50), concerned with the retention of orally presented pé j 
rials. In one phase of this study Spencer tried seven combinations of d 
ferent frequencies and temporal spacings of the administrations of a pee 
test to pupils to whom certain expository materials had been p 
orally. The seven experimental groups involved (one for each com "s 
tion) were each composed of eight school classes. Since the classes ex a 
of approximately the same size, Spencer dealt with the unweighted ¢ s 
means as individual measures, The subjects were given an initial i ^ 
learning ability and a final criterion test after a lapse of sixty-three E 
during which the various experimental procedures were administere® = 
standard procedures of analysis of covariance, Spencer analyzed these ii 
so as to obtain (a) a "between groups” variance adjusted for dit 
between the groups in learning ability as revealed by the initial test, es 
(b) an appropriate error variance. Hence, by means of the F-ratio - ari 
able to test the hypothesis that learning ability being constant, the exP ary 
mental procedures are equally effective. The difficulties met in the gan þe 
matched groups experiment are considerable, but those which Wo" Pt 
involved in an attempt to make up two groups of intact school putt 
would be almost insurmountable. The method of analysis of n T 
permitted the equivalent of such an experiment with a minimum © 
ministrative difficulties. 
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Conclusion: Need for More Complete Reporting 


P nr sant qos the studies cited in this chapter, as well as many others 
Gute ciens : the reviewers noted again and again the sketchy and inade- 
mE a in which the procedures used were described and the findings 
idtm. aed many instances it was utterly impossible to infer from the 
stewie mpor what statistical procedures had been employed, or, 
the iiri T siu could be identified, to check in any satisfactory way 

; FM GRE es kd their application. The present review indicates a real need 
imme: Dor ig = application in education of the newer statistical tech- 

fbr rere in the opinion of the reviewers, there is an even greater need 

SUE cami pem es complete, and meaningful reporting. One need 

MAR. but a oe original data or reproduce all computations In à research 

io decide lm studies are at least so reported as to enable the reader 

WES emplo wt himself whether or not an appropriate method of analysis 

used (a yed, or to check the crucial steps in the application of the method 
1n DP i dee or inappropriate), the findings have no scientific value. - 

ihe ve o the research workers it is only fair to say that the editors of 

search journals may in part be responsible for this situation, through 


CA urging brevity. They, at any T 
vement that is so seriously needed. 
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CHAPTER V 
Evaluative Studies 


ALVI e 
IN C. EURICH, C. ROBERT PACE, and EDWIN ZIEGFELD 


Scope of Chapter 

Paco 

all the way £ STUDIES IN EDUCATION are numerous and varied. They range 

nified as nthe casual and informal appraisals that can hardly be di 

Fears Oi true 3 or research (1, 26) to elaborate investigations requiring 
> by relatively large staffs richly endowed with foundation 


Support (2 
). No attempt is made in this chapter to review all studies that 
ire issue of the REVIEW 


Come with; : 

hm this range. That would require an ent 

of the over. lle chapter. The scope, therefore, is limited to a discussion 

Studies myd evaluations of entire e s or institutions. 

Kredita ier an evaluation of sc 
ne Fes dip ps have been extensiv 
i is limited, furthermore, to eva 


high 

er educati . : 

mentary Mie nee Because practically all children v 
des now go on to high school, the few follow-up investigations 


that hay, 

in m bd o at this level are primarily concerned with achievement 
prevent i hools. Although this phase is important these restrictions 
Clark and oth igating acceptance of responsibility and community living. 
9f education s (6) in 1940 summarized studies on the social effectiveness 
Subjects, in such areas as financial and vocational success and schoo 


udies of second&dy an 
vho complete the ele- 


Fro 
m 

Measurement to Evaluation 
the past few years in the nature 
(40, 41, 44, 60). The most 
broader scope of these 


hasis was upon measurement of 


Mark 

e : 

9f the es en have taken place during 

apparent "e: designed to evaluate educati 
, perhaps, the most significa 


Investi 

; igati 

Single ee Whereas previously the emp d t 
NOW more s of achievement, discrete behavior traits, OT specific abilities, 
s and more stress is placed on behavior patterns or appraisal 


of th 
e educati TONER » 
cational program in terms of all the major objectives it seeks to 


attain (32) 

WO mat 

kii TERSUS CAN be cited for this change. In the first place, as 

ecomes techniques improve or as they are available in wider variety, 

avior and possible to measure larger and more complex aspects O° ^ 
to judge programs in terms of more comprehensive criteria. 

3 has changed 


nt 
€ sec 6 : 
rom cond place, the prevalent conception : educa P 
el opment of speciüic pes 


on a 
of aque Sey concerned with the dev t 
ment as in spelling, knowledge of American history, OF physics, 
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nt is the 


Mea 


> @ specific courses. Alt 


m 
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to one concerned with the development of total personalities whatev? 
that might mean scientifically. Psychologically, stress on interaction aii 
supplements that placed upon reaction. This has led to broader Proto?) 
of evaluation as described by Eurich (16, 17), Foster and Wilson (55), 
Lorge (33), Raths (47, 48, 49), Smith and Tyler (51), Troyer : 
Tyler (57), and Wrightstone (61, 62). 


Purposes of Evaluation 


" A p e of 
Evaluative studies are undertaken for a variety of purposes. Som 
the most important are: 


ior 

1. To check on the effectiveness of educational institutions in terms of n 
changes in or achievements oj students —Most evaluation in educational inn t 
has been concerned with testing or with other methods of appraising the kopt med 
and skill of individuals gained in courses (36). Educators have generally aee urses 
that desirable behavior or action will follow knowledge and skill. In most € 
the achievements of students, as measured by tests and examinations, are 
diate ones—those apparent after a short period of rather intensive training. ht-Year 
trast, the tests developed by the Cooperative Test Service (9), and by the Eig use t 
Study of the Progressive Education Association (51) are not limited in Lor 

c hough the effectiveness of a program can be measure Micates 
by immediate results, the fact that much education is designed for future use inc r 
the nei for an evaluation of student development over a longer period ofr Aes make 
leaving school, individuals are subjected to many situations. Their abilities t° "heir 
the necessary adaptations in after-school life and to achieve in relation E: re 35 
capacities constitute acid tests for an educational program. Consequently, ier 
the need for follow-up studies which are broad in scope and not limited, * 
many of the earlier appraisals, to financial and vocational success. s the 

2. To plan future educational programs and procedures—This purpose olive 
first. Most evaluative studies are being made to provide a basis for improvPe dy 
program (25, 30, 37, 54). Again, to serve this purpose the studies must be 5? e. 


icult 
broad to affect not only the administrative policies of the institution but pue in 
policies and the counseling of the individual student as well. In short, they 
cover the total program, 


y : edu 

3. To accredit institutions--With the development of a broader conception ee pri: 
cation, considerable dissatisfaction arose with accrediting procedures concerne 
marily with the financial resources, the number of books in the library, 
training and experience of teachers, The evaluative studies that are setting UP pjec 


A Ps mn ro 
patterns for accrediting procedures are likewise concerned with all the majo other 
tives of the institution (7, 42), i 


; They follow, therefore, the same tren 
studies. 


Methods Used in Evaluative Studies 


t 
tmen 
Most of the methods used in evaluative studies are given full tre? 4: 


jes 
elsewhere in this issue. By far the commonest method in follow-UP 
is through the use of questionnaires. These have proved to be ume g for 
flexible and economical, though by no means the most reliable, met " in 
securing evaluative information. Rating scales are at times incorpore n 
or supplement the questionnaires. Analysis of records gives informati? uals 
the administration of the institution and on the development of in uem ure 
over a period of time. Tests are perhaps the commonest evaluative me 
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applied to st . 

variety of Rite e school and can be constructed to mea: i 
tuus ok wa and behaviors. Direct observation furnishes rip ge 
ai biegen) to an extent not possible by any of the ab e nde 
tiis subjects, D pene mw method of investigation as oh ee 
t of thinking a id Hites properly used, can encompass more di : 
fid thenselve g and acting than the first four, but h e 
The reesei to statistical treatment. idol zee 
pate ist pde gin methods in evaluative studies is that a wide 
cob. Stages nd TS comprehensive evaluation is to be made. Each 
a rs, each is subject t nitations, each complements and supplements the 
cation ave defen o misuse and misinterpretation. As new values in 
"fined, as new needs arise, new techniques must be devised 


toa 
ppraise 
> aspects " 
s of the educational program in order better to evaluate 


the whole. 


Deseri 
cription: 
s of Eva i 
Evaluative Studies at the College Level 


clude the extensive 


Out 
standi. 
ng c s 
g comparative studies of institutions in 
dation 


work 

of the N 

s Nor! rer 

ihr of d EA Fi Association (42) and the Carnegie Foun 

hievement examir ennsylvania (31). The latter was based primarily © 
nations in the major subjectmatter divisions di oitese 


Programs, 
ograms were con- 


Prior to 1 
c 941 
eo only with (p follow-up appraisals of college prog 
of "pu (14, 15, 19 a objectives of economie and occupational 
Unique P Tine of oan a c. 38, 52). The most recent and extensive 
entific contribution lies 9 ^e character is the one by Babcock (3). Its 
iving I win based n p^ fact that the data were drawn from a sci- 
Men. sited Siatocancllen e Fortune poll technique; of the status of a 
trai ate data availabl ege graduates. It provides the most complete and 

Pd. men and veri the economic and occupational status of college- 
. o OHow-u È ud 
— Se iiie = with a more complete range of college ob- 
Sl The nist lh atively few, but undoubtedly their number will in- 
sg conducted b : cay in terms of the range of objectives covered, is 
is ‘a by Pace (45) General College of the Universily of Minnesota, 
the Ting it more ne. he The General College was revising its curriculum 
i adults they we Ary MB line with the characteristics of its students an 
a sample of es likely to become. A 52-page ques sonnaire Was sent 
mer. of college a Minnesota students, ates and nongradu- 
ti ities, probl Ee Zrom ‘one to twelve years. 
onal, home ems, attitudes, and interests in fo s of living— Voce" 
Profusely mum family, socio-civic, and personal. ‘Attractively printed and 
sep former sei the questionnaire drew re 
Scales to meas ents who received it. In the question 

nservative eia job satisfaction, economic status, 

attitudes, general adjustment, and mora 


naire were $ 
cultural status; liberal- 


le. All the jtems were 
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. 72 of the 

of the checklist type. Supplemental interviews were held with 172 o 

E uestionnaire respondents. d aon: 
pores oranes Qum between the responses of cvs ud ale Fe 
graduates provided the basis for judgments concerning ee A: eem 
college education. Further judgments about the strengt 4 ce "pical pattern 
of the college program were based on the extent to which t s pons SERE 
of activities, interests, and attitudes of the college-traine eved ee 
sponded to the kinds of behavior which the college faculty be e indicate 
characterize college-trained adults. For example, the V pec: oblems; 
that these adults held inconsistent attitudes toward related social pr cr THES 
that many of them were interested in effecting home esa fa ‘oad 
followed many uneconomical practices; that they were Ley ae dh 85 
national problems but not in local and community affairs. Resu 5 ait 
these were interpreted by the faculty as reflections—at least in p roblem 
the inadequacy of the college program. The basic interpretative Lime e 
of follow-up studies of this kind lies in this question: To what "umts 
we justified in praising or blaming the college for the activities, 


: : f college 
and attitudes of young people who, in this study, have been out o 
" ef one to twelve years? 
In th General Colle 


"5 ges O 
liability*and validity of responses was available. Approximately 7 pag 


oom eliability- 
the questionnaire consisted of standardized scales of known relia 
These reliabilities centered in 


` oup 
and cross comparisons among the various e 
suggested that the differences in responses were in line with what one 
expect 
Th 


ajority had checked the items because they 
€ about them. The staff professed least pe 
in the answers given to these questions. Many questions of this tollo 
employed by Fenlason and Sletto (20, 21) ina questionnaire 

594 


p wer? 
w-up 


*— 
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study of soci was 
tod ees a“ oe ele in Minnesota. In a section on social case work 
questioni i es se of thirty-seven techniques was preceded by the 
technious Sn i feel an urgent need for additional knowledge of this 
the Haiya e satisfactory performance of your work?” The focus of 
olan ecg — job analysis and the phrasing of the question in terms 
than os cun provide a more appropriate setting for this type of item 
Other BE E General College study- 
cational en one attempted to appraise the effectiveness of their edu- 
vectly their phi y sending questionnaires to alumni which solicit di- 
The folloy pinions concerning the values of their college experiences, 
W-up questionnaire sent to former Bennington College Dub 


(18) a 
nd the Stanford follow-up inquiry by Isle (27) are examples. One 
: “l. individual conferences 


item i s: 
sim ee a list of fifty features such as 
housing se 2. social life at the college; 3. system of trial majors; 4. 
factory,” fs lities. The alumni rated each of these features as "very satis- 

»” “fairly satisfactory,” “neutral,” “rather unsatisfactory,” or “very 


unsatisfactory.” F s 
y." Free response oF C88AY questions were also used. For ex- 


ample, “List in ord i 
order of importance the experiences, courses, or instructors 
o your developme 


that, j 
b m your j 
While at aka made the greatest contribution ti 
gton." “What defects were there in your coll wor 
stionnaire Was desivned for 


as you see į 
alumni who eii The Stanford follow-up que 
Scales, bedle engaged in teaching or in other educational w 
& he chief ene and free response items were also included. . 
ad to which ey problem in this type of questionnaire lies in the 
th ege experiences, "s can introspect reliably about the values of their 
fg oues of their. q 15 likely that old graduates develop a halo about 
C ble. The pur education which tends to make their judgments unre- 
Titicisms on b ve of the investigation may likewise influence results. 
ogers (49) hon these points can be made of the work of Tunis (56) and 
Were made is oth of these studies included old graduates, and both studies 
> to celebrate college anniversaries: the former to commemorate 


the 25th reuni 

anniversary of V. of a Harvard class, and the latter to celebrate the 75th 

s subjects of Vassar College. Greater faith in the results is justified when 

s are recent graduates and when the purpose of the investiga- 
ducational program. 


tion is fr 
ecent ees to evaluate and improve the college € 
sights to uates experiencing the demand of new tasks may have valuable 
Shortcomin ontribute to the college faculty regarding the strengths an 
Braduates E of the instructional program. Isle (27) report 
employers. much more critical of the Stanford program than we 
ef 

ollow-up study, as a means of apprai 


Cation, ; 
evaluation cf. most appropriately as but one 
nington Coll a college program. The complete ev 
and Starr cge, the General College of the University 
achieven University’s School of Education (35) us 
nt tests, numerous questionnaires, checklists, interviews, 8 d 
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g c in colleg low-up of 
ing scales with students and faculty in college as well as a fo 

D.S 

graduates. 


Evaluative Studies at the Secondary-School Level 


at- 
Four major evaluations using follow-up studies as par a E hé 
tern of appraisal may be cited—the American Youth coa Regents’ 
Cooperative Study of Secondary School Standards, iet 5 Etui 
Inquiry, and the Progressive Education Association Eight- . tud 
Stimulated by the youth problem of the depression years, tto deter- 
(4) for the American Youth Commission was a pioneer attemp ppa 
mine and analyze the status of a representative sample of Mary T. n 0 
ages sixteen to twenty-four. Interviews were held with more — rimi 
young people, sampled on the basis of sex, race, school status, Jo d other 
social and economic status, marital status, type of community, T ae. a0 
relevant factors. The study was concerned with youth at school, E of the 
work, play, and church. In appraising their schooling, Giese S 
total group said they had received no vocational guidance (yet 4 tine or 
security was their most pressing problem), 27 percent attribute little or 
© economic value to their schooling, and 12 percent attributed d their 
> EN cultyral value to it. The amount of schooling youth received an 


P Á k ationa 
appraisai of its value were clearly related to the economic and occupé 
status of their parents, 


Nham- 
The follow-up phase of the Fight-Year Study has been reported by ie 
berlin and others (5). Graduates from thirty experimental high ne o 
Were matched with graduates of traditional high schools on apto e. 
scholastic aptitude, sex, race, age, religious affiliation, size and has 
high school, size and type and location of community, icc atm uent 
of family, and extracurriculum activities in high school. The qu re 
success in college of both groups was compared. College records và use 
ports, special questionnaires and lests, and personal interviews WB intel- 
to gather evidence with Tespect to nine aspects of college success hiloso- 
lectual competence, cultural development, practical competence, P jtivity 
phy of life, character traits, emotional balances, social fitness, sens? ects 
to social problems, and physical fitness. In many of these areas or e odi 
of competence the mass of data for each student was summarized by bern 
of judges’ estimates of its correspondence to briefly described be dents! 
levels or types. For example, to get a judgment on the extent of stu 


ing 
3 a ` 1 llow? 
interest in current affairs each case was rated to fit one of the fo 
five categories (5, p. 13): amand 
z 5 oni 2 cor - 
1, Matters of social, economie, political, and humanitarian significance 
his interest and objec 


4 : riting 
tive study. Does something about it. Membership, WT 
tributing, agitating. 


2. Considerable reading and discussion of these matters. Many matters gt 
economic, political, and humanitarian significance command his interest. May 
not do anything about it, 

3. Somewhat limited or in 
aware of them. 
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or may 


iy 
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constant interest in many phases of these matte 
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4. Limit S, ni ttle attempt to kee ith w 
d ed to i i pi 
certain phases, or sporadic only. i keep up with wh: 
at 


is going on. 

5. Not interested at all. 

This rati " 
Derler —— aang has been used previously and comprehensively b 
sidens of im iams (11) in analyzing the case records of one i | 
Bordin (58 s eia s General College and their parents. Williamson and 
records in ehe used a similar method of rating materials from case 

Other ore D success of student counseling. 
noteworthy. The bs ssn pee follow-up in the Eight-Year Study are 
Mn cm iin “| selected graduates from the six schools whose pro- 
practices, ind : ged to have departed most significantly from traditional 
tiem bos €: from the two most experimental schools, and compared 
differences E d students from traditional schools. In these comparisons 
tenter than ae experimental and control groups were successively 
groups. Simple sp revealed between the total experimental and control 
highly piei : and common sense methods of analysis such as these are 
opment, are Lian for evaluative data which, at the present level of devel- 
of the Rieces precise in any mathematical sense. Final value judgments 

"cess, goodness, or effectiveness of educative experiences are am e 
s 


should } 
be based on the main trends and major patterns of rest} ggfrom 


a variety of data, 
Marshall (4 appraisals in the Regents’ Inquir 
attitudes iu - A battery of tests of inform 
obtained fr s given to pupils about to leave hig 
withdrawal. A questionnaires and from school princi 
for the futu nalysis of the traits and attitudes, pattern 
vides evide re, and present school and work activities t 
ences of the social competence of leaving pupils, 


Cation 

» of the succ i 
e success of the schools’ programs: Subsequent in 

held several month 


© pupi ree 
pils, principals, and a third party: 
t on the vocational, 


y are reported by Eckert and 
ation, skills, aptitudes, an 
h school. Further data were 
pals after the pupils’ 
s of interest, plans 
hus obtained pro- 
and by impli- 
terviews with 
s after with- 
social, and 


eisure.ti 
Te-time adjustment of former pupils. 
School Standards (7) a seven- 
ary schools: inj hundred second- 
s: use of the Evaluative Criteria (8), = of field com- 
of pupils rd tests, college success 
of parents Mn success of pupils, ju judgments 
SESS; None nallege success was measur 
Questionnai ege success was judged from 
aire which called for ratings 0n 


ulne 
SS of s - 
Schoo] in ure in vocational placement 
ppreciations à 


e i . 
Dents on th veloping various a] 
e satisfactoriness of high-school ex 


in 
scho 
ol wi C NE 
essay E likewise obtained from questionnaire co 
g Ne iie items. Parents’ judgments Wer? solicited 
ès with respect to their degree of satisfaction W 


f former pupils to a 
leaving school, help- 
contribution of 
d general com- 
ents of pupils 
scale 


responses [uU 
reasons for 
and progress: 
nd interests, an 
perience. Judgm 
i mbining rating 
by questionnaire 
ith twelve aspects 
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TE ; ial life, 
or goals of the school's program—such as good citizenship, socia 
ducational guidance, and reading habits. Yin 
: € other evaluations of schools by students, parents, and lay 
have been made (24, 28, 39, 43, 46, 50). 


Contributions in Method: Approaches to Evaluation 


, other 
The studies reviewed here are the most comprehensive. cum t 

studies could have been cited that used one or more of the w The con- 
of methods employed in the more comprehensive investigations. ns have 
tributions to methods made through these extensive pia ad in 
been general rather than detailed. No new techniques were pei 
any of these major investigations, but new ways of adapting an revious 
them were developed. The methods had all been used and tried in pee as 
but more limited studies. For example, the institutional pattern ied 
used in the North Central Association studies had been used open an 
a less extensive study of New York colleges. In essence the d and the 
adaptation to institutions of the profile charts for individua om tech- 
data for each variable on the map were gathered through Po Some 

2» 45; niques, such as tests, questionnaires, records, reports, and pe am the 
majo ntributions, however, were made in adapting old metho proa 
comprehensive problems investigated and in setting a pattern for 
approaches to evaluation, These contributions are: 


l. In refinement o 


aire 
used in the Minneso 


jonn 
Í methods—For example, the 52-page question this 


: SUME of 
ta study represents a high point in api ar to 
technique. Great care was taken in formulating each item in 


Sm form 
eliminate ambiguities, The questionnaire was tried out in Dom these 
before it was printed with attractive layouts and many illustrations. articu* 
ways a method that had been used extensively was refined for en ex 
lar study. Similarly, in other investigations the older methods 
tended and refined in application, chensiv® 

2. In the use of a wider variety of methods—In the more compr' 


commo” 
evaluations, a wider variety of methods has been used than was 
in the earlier studies. In th 


questionnaires, rating scales ji reviovs 

of curriculums were all used. The best of the methods developed inp more 

investigations were applied in a si 

comprehensive evaluation. 
3. In analyses o 


evaluation—In pr jor investigations ee j 
chapter, emphasis was placed upon the analysis of objectives 


al. i on 
for determining what data should be collected. In the Benningt tees ® 


-S 
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records ; : x 
sinis T = IDEE Briefly, this procedure, upon which the major 
gree, means that a sound evaluati f i 
au. a uk s ion of an educational 
only in t j jecti e 
D Arcus y erms of the major objectives that program is set 
. In followi Ind 
The ae rode up individuals over a relatively long period of time— 
in převious s mas of recent years have sought to correct a deficienc 
peod of A u a by following up individuals over a relatively ee 
e. The Pennsylvania study (31) established a new e 


in this r : 4 
egard. Likewise the Eight-Year Study by its title designates a 
f the earlier studies made over 


follow- 5 

à bd e pos The spot evaluations o 

the pedis o were clearly. inadequate because they did not reveal 

E Gaal. wns E of the educational program to after-school life. As long 

dais dor thet e case, institutions could make all kinds of unfounded 

lie tinge tke T programs. If follow-up studies of this type continue to 

significant th ime may come when such claims are regarded as no more 
an the tales of the miraculous healing qualities of herbs 


d.n by the old medicine man. 

ons o pee follow-up stu 

N Line sals of education will be available. 
cant evaluative studies. 


dies must be made before more adequate 
This will mean fewer but more e. g 


Contributi 

ntributions in Terms of Results 
clearly disappointing if viewed 
for it. The Pennsylvania study 
lishments in many students 
In the New York Re- 


L 
jue uw contributions of education are 
1 le of the claims made 
who had ge unbelievably low accomp 
gents? In le advantages of a college education. 
quiry, Spaulding (53) found that: 


Amo 

ng the 3 

the schools an and girls leaving school each year are à considerable number whom 

Irrespecri emselves are unwilling to recommend for responsible citizenship. (p. 17 
iv 3 2 h 

Pupils as ai of the schools’ judgment of their readiness for citizenship, the leaving 

ISsues, and epa are seriously deficient in their knowledge of the problems, the 

P. 18-19) e presentday facts with which American citizens should be concerned. 

ng school, whatever they may think 


Th 
€ boy. 
s A 
al and J 
bout the dui who are on the point of leavi thir 
le coo a ility of certain kinds of action, are reluctant to assume responsibility 
peration, or to commit themselves to action which will involve personal 


Or civic 
effor 
t or sacrifice, (p. 24) 
practically nothing to add 


One 

e he is 

ff. = readiness > school, the ordinary boy or girl does adi 

^» S for citizenship, nor does he even keep alive the knowledge of civic 
he may have had when he finished 


a 
his 2S, Or the i : 
S schooling, ix db in.social problems which 


In th 
e Mi 
M study, Pace (45) found that: 
th aduat, 1 
and Were ond s distinguished from the nongraduat 
few qoe what ikely to have professional jobs. 2 ittle—but n 
3i Ringe ee satisfaction with their jobs Tn other areas 9 
» OF none at all, between graduates and nongraduates. 


es chiefly by the fact that 
ot much—more jncome, 
f living there were 


(p. 51) 
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' " sation 
Briefly then, the results of these follow-up studies show ke rau. on. 
has not been as effective as claimed by those responsible for cart e gn ex- 

2. Broader evaluations have been made possible—This M En we 8 
pected from the application of a wide variety of galar n avi 
growing out of an analysis of objectives. These broader a such 88 
in turn, made possible better solutions to practical prob ie h Central 
those involved in accrediting. The pattern map of the a ondary 
Association and the Evaluative Criteria of the Cooperative »ec 
School Study are examples. - the 

3. An e hn of Wis of relatively mature iuis non 
effectiveness of the educational process has been provided—VFor tribution 
part these judgments give a more encouraging picture of the son than do 
that schools and colleges have made to the lives of titel wl" 
test results or analyses of the civic or social life of former stu stinutions 

4. Perhaps the major contribution. is that derived by the e ating 
which conduct them-—1t the study is made with all groups part? "m an 
as was the case in the Bennington study, in which students, facu on th 
trustees all took part in a cooperative undertaking, the effect "en a 

GI institution is a major one. Thus, evaluative studies can and do tion. 
impolnt step in the development of the program at a given institu 


Major Criticisms of Evaluative Studies 


ed 
ä CAN " » x uard 
Major criticisms of evaluative studies which need to be 8 
against in future investigations are: 


1. The instruments used are not 


A he re 
naires, for example, are in many cases elaborate but their validity e o 
liability of results are too infrequently established. The refino tribute 
instruments may be only an elaboration and may not actually © 
to the accuracy and dependability of results. 


$ ted 
f ; T isola 
2. The direct contribution of the schools and colleges is not is" 
from contribution 


: s the 

is of other experiences. Because the individual © wy 

product of all his experiences and his native endowment, it is PT@” js 
impossible to isolate the contributions of the educational program wp 
development from the contributions of other experiences. In ae long z 
studies it is desirable that the investigation be extended over aS i 


period as possible. The longer the period, however, the more di 


becomes to determine the effects of the educational program beni 
other experiences intervene. From the standpoint of the indivi colles® 
probably not important to isolate the contributions of school or et 
experiences. From the standpoint of evaluating the educational oe ip: 
it becomes very important to do so. The “control technique" aS inve?! 
the Eight-Year Study is the only method used in the follow-up or! of 
gations for isolating, at least in part, the contributions of one 
education over anothe 


T. 
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3. El PERPE: = ; 
RE of studies is discouraging to many school systems and 
No cise d smie to make an over-all evaluation of their programs. 
likely to he de ~~ technique has as yet been devised nor is one 
Él program - = will provide an evaluation of an entire educa- 
takeran coi aa or this reason many schools and colleges feel they cannot 
evaluation. prac jon of their program. Every institution, however, has an 
8S such, ‘The dia EE on at all times whether or not it is recognized 
primarily es : mpre hensive investigations which have been undertaken 
though Kec esearch projects provide many valuable suggestions. Al- 
calticism ing methods may need to be devised for ordinary use this 
tere tiat] not be taken too seriously at this time. Tt is mentioned 
onic in because many institutions have used it as a rationalization 
4. SM Mati, a more concerted effort to, evaluate their programs. 

the P rs cm do not reveal contributions to the development of 
groups. Case : ractically all the evaluativ 
tending cie ee have been made but are 
lensis e arch studies there 1s considerable 

case studies over a long period of time. 


e studies summarize data for 
difficult to interpret. Tn ex- 
need for making more ex- 


In spi 
, 7n spite of these criticisms, considerable p * 
More 


In 
ana e pur decade in extending the scope 0" * 
evaluation chool systems, colleges. and universities are 
usually i a, in terms of their major objectives. ^he 
Pose of ener ae to who should carry on the process. Clearly if big rt 
Program, th abon is to provide a basis for improving the educationa 
In the eina responsible for this program should take an active part 
an RA 'To be sure. competent technical direction is yt 
Operative an is made for such direction the institution, ret As m 
Carryin ertaking, may make further contributions to the methods tor 
g on evaluative studies as well as to the effectiveness of its own 


educati 
cational program 
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CHAPTER VI i 
` s 
Questionnaires, Interviews, Personality Schedule 


FRANK W. HUBBARD 


The Questionnaire 


najot 
In Chapter IX of the December 1939 issue of the Rauen ma pie 
criticisms of the questionnaire technique were pointed out. 3 iven in 
fessional literature reveals, however, that in spite of the ee iam to 
this and other research publications, the common mistakes "2 restrict 
appear with some frequency. There has been some iru Pom] an 
the use of the term "questionnaire" to forms that require stall ee been 
objective replies; the terms “opinionaire” and boc ont ston Un 
used by workers at the Character Education Institute of Was DAR 
versity (15) on forms calling for subjective and qualitative Qo di- 
Relatively few research studies have appeared since 1939 d of im 
Py ectly nd experimentally with the questionnaire as a metho treated 
vestigation. A number of recent books and articles have, however, e. Par- 
the methods, errors, and limitations of the questionnaire Fo mm 
ticularly useful are the chapters by Koos (14), Lindquist (19). E with 
(20), Toops (41), Wert (42), and Young (44). Magazine artic 


an 
helpful suggestions have been prepared by Jenkins (11, 12) 
Phillips (27). 


Preparing the Questionnaire 


ht am — -— ;s of opin 

Wording-—The use of the questionnaire technique in survey E? je (1) 
has led to greater attention to the wording of questions. Opinion e 
and Rugg (32), from experience with the Princeton Public OP 


jons 


(such as Roosevelt or Hit 
specific political questions, 
of “danger words” characteri ur : 
high vocabulary level. Jenkins (11) suggested that there are fo answers; 
ways in which questions may reduce the dependability of the «]oaded 
(a) by predetermining the answer thru the use of leading T use 
questions or thru the improper order of the questions: (b) ER pilitY 
of ambiguous terms and vague questions; (c) by exceeding lex que. 
of the respondent to use unfamiliar words or to deal with gp he 
tions; and (d) by inviting inaccurate responses. Ghiselli (9) yer! apa 
respondents were more willing to reply and that their replies Y opinions 
erally more satisfactory when they were allowed to qualify their °P pge 


3 vith 
than when they were forced merely to agree or disagree W! 
statement, 


cist 
Blankenship (3) pointed out the 9*7, (5o 
H ajo! 


F6 4A 


P 


Ds 
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mber 1942 QUESTIONNAIRE SCHEDULES 
: = IONNAII > N 21 > J T 


Pr i; z 
eg e Blankenship (4) and Sletto (35) reported that pre- 
lobo e questionnaire with small groups insures greater reliability 
swers and increases the probability of a satisfactory return. 


Questi i r 
stionnaire Administration: Sampling; Follow-Up 
d attention to the fallacy of using 


merel NP 
in inti Tes number of individual replies from a few schools when 
y the school is the unit. He recommends "stratified sampling" 


or th : 
total 2 selection of cases from each identifiable subgroup within the 
population under investigation. Both Reid (28) and Stanton (36) 
veys are not necessarily rep- 


sh 
ed pue responding to mail sur r 1 ; 
the sonum the nonrespondents. In both studies having to do with 
more like] E of radio equipment it was shown that the "haves" are 
mended i 2 reply than the “have nots.” Follow-up procedures are recom- 
the mei dB proportion d thereby to reduce 
mailed ities of bias. Suchman and McCandless (37) found thru further 
Meri d c and telephone interviews that the interest of the 
tion affe ad the topic under consideration and the amount of his educa- 
able «n e the return. Pace (26), in attempting to determine am 
tion fro "p of the bias in a study of college alumni, reported that adua- 
completed e university and the number of quarters of university work 

In stud a important factors in influencing the returns. , 
found wa 2 the flying habits of the patrons of airlines Rollins (3 ) 
Inquiry and eerie questionnaire gave ? truer picture than a single 

an a sing] that double inquiries to a small list yielded greater gum 
the employ e inquiry to a larger list. Shuttleworth's inv )o 
of large Mia status of majors in tecl 
Inquiry sampling errors from incomplete returns. n 
questionn lowed only 0.5 percent unemployed; replies 
to 6.6; m used as a follow-up raised the percent o 
Broup, en a final drive, resulting in almost complete 

P, brought the percent of unemployment down to 4.0 percent. — 

i s in submitting 


hirea, j 
z cues TEME returns—Moore (23) varied his procedure ti 
lonnaire to superintendents of schools. He found that typewritten 


etter, : 
ok ge transmittal brought 16 percent more responses than did dupli- 
: etters. Follow-up letters produced a further 16 percent increase 


e nu 
mber of replies. 


Sampling—Lindquist (18) calle 


estigation 
ed the possibility 
from the origina 

from duplicate 


f unemployment 
e 


Reli 
abili 
ility of Questionnaire Returns 
replies of 216 teachers 


ewis $ : j 
en a ^p investigated the consistency of the F 
Naire H ed to respor on two different occasions to the same ques cu 
Varied € reported tha: in the second reply more than half of the teachers 
Sistent their responses on more than alf of the items- In A er 
te i i n percent: 
athe dees oe with respect to only 

E pma s e jed on as high as 96 percent 


tems: i 
ms; in other cases, the responses varie 
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of the items. Lentz (15), using a social science “opinionaire,” found d 
on specific questions occurring with amazing frequency. Such b. perd 
would be expected, however, in responses to questions dealing with op! A 
ions. He concluded that the summation of reactions on a number of ies 
was reliable. Neprash (24) studied the statistical reliability of question 
naire returns, reporting a 20 percent unreliability of responses to Fey RA 
questions on social attitudes and opinions. These studies indicate the id 
portance of proper questionnaire procedure and the limitations of cer 
types of replies. 


Special Uses of Questionnaires 


Byler (6) reported the use of inquiry forms in ascertaining the interest 
and needs of students prior to a program of curriculum revision. pc 
(16) found the questionnaire procedure effective in calling the m ip 
of pupils to certain problems of pupil conduct, study hall conditions: g 


B É ` ntly 

When followed by discussion in homerooms the results were appa igh 
more satisfactory than the “preaching” plan so often followed widance 
idanc 


schools. Gilkinson and Knower (10) described a multiple-choice gu". 
Cuesta for students of speech, Cureton (8) recommended the qu 

tionn (and other procedures such as the interview) in promoting (n 
thinking. Outland and Jones (25) described the application of ; 
questionnaire to curriculum appraisal. They warned of the limitations o 
the procedure, however, since pupils usually are interested in imme ial 


problems more than in remote matters even tho the latter are vital. 


The Interview 
e inte 


Few research studies have appeared recently with respect to a ly four 


view. Symonds (38), in an article on research in this field, cited om'Y " 
studies during the entire period from 1926 to 1934. Based chiefly 7 en” 
perience rather than on the results of controlled studies, a number of a i 
eral discussions of the interview technique are available. Among these n 

articles by Aldrich (1), Johnson (13), Symonds (39), and Wilkins eA 
Kennedy (43). One usually finds in these discussions considerable emp y 
on the importance of "rapport? with the person interviewed ; the pei 
of privacy; the wisdom of making systematic records after the conferen e 
and the advisability of verifying data and using caution in making intep 


Deon i Cd the 
tations. The inquiry forms devised for a personnel research study I tg 
General Coll 


ege of the University of Minnesota (22) have been terme 
contribution to the tools of social inquiry." + Ability 
Schellhammer (33) suggested three ways of compensating for variab, 
due to personal elements in an interview: (a) arrange several jnterV’ sch 
per interviewee, each conducted by a different consultant; (b) have hase 
interview conducted by a series of experts, each concerned with the Pants 
related to his own field of specialization; is (c) have several consult 
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sit as a committee to ch interview. He also mmended th; 
> to conduct ea } that 
à n e also reco: al 
each interview be focused on a single, clearly defined purpose. 


Recording the Interview 


Symond 

sorte at oh ae to discover experimentally the amount and 

; 2 orgotten in variou iod n i 

Cone g s periods between the intervi 

nn n HE concluded that records made immediately after ee 

eu te ed the maximum of details. Most significant parts of the cim 
, "i i i 

corded te were usually not forgotten even tho not immediately tte 

selatively = lapse of a reasonable interval of time resulted in dropping 

: nimpor i i i 
Milan Rony iportant details and may have favored integration of sig- 


Vises 
ocabulary of the Interview 


Man ; 
Fine de. the studies that apply to the formulation of questions in ques- 
s apply equally to the interview procedure. Roslow and others ^ 


(31 
) reported on the basis of field studies of the Psychological Corporation 
emotionally charged words may produce 


-— e of stereotypes or 
checklist m in responses; also, that the responses to ao i 
the p E are influenced by the number and the compleltgyss © 
or different “a oung (45) called attention to the differences jn meanings 
ment,” and [penne of such common terms as “housing,” *unemploy- 
tion of the ies ’ Her recommendations as to careful organiza- 
Simple words e » recognition of the backgroun 
to the pro , and avoidance of emotionally charged word 
posals usually made with respect to questionnaires. 


d of respondents, use 0 
s are similar 


Speciz 
cial Uses of the Interview 
s being used more widely 


the interview i 
Anderson (2) suggeste 


As i 
in alati e the questionnaire, 
that Viífs be 5 and instruction. For example, And | (2) sug 
Characters in encouraged to prepare "imaginary interviews with the 
s of history since the method requires familiarity with facts about 


each ch 
ari 4 : a 
i acter studied. Robinson (29) suggested the interview as à Way 
eceive suggestions from teach- 


9 disco 
ve RSs 
ers with v administrative problems and to r 
Interview Aven to their solution. Merrill (21) advocated the use of the 
obtaining material for high-school papers and in other news- 


Batherin s 
8 activities. Brophy (5) found the interview à valuable supplement 
ersity students. 


to tes 
St resul 
ts and questionnaire reports in counseling univ! 
Tisoni Personality Schedules ` 
nali 7 
ity and character tests were treated in Chapters V and VI A js 
e 


E Tuary 
yl : 
add 941 issue of the Review. On 


ed here, ly a brief note; 


1 
This 
Secti, 
‘on was prepared by Ruth Strang 
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ame areas 

The California Test of Personality (49) covers dump ee ower age 
as the well-known Bell Adjustment Inventory, but inclu a divided into 
level. The profile constructed on the basis of the responses hat different in 
two sections: self-adjustment and social adjustment. Somew ent Inventory 
form and most carefully developed is the Detroit "mdp aufus d 
(46) designed for junior and senior high-school epidemies there are 
120 items dealing with 24 “problem situations. For eon dicates the one 
five statements in the first person of which the subject indica more than 
that describes him best. This inventory has been in use for differences 
three years in the Detroit Psychological Clinic and significant seven non- 
were found between scores of sixty-one behavior and Lax (53) is 
behavior cases. The Minnesota Multiphasic Personality Schedu C structed 
superior to the personality schedules whose scoring keys were c standard- 
on a statistical rather than on an experimental basis; it has prion 
ized on 1,500 normal individuals and on 220 psychopathic P McCall and 
unique features of My Personality Growth Book developed by nd use pri 
Herring (54) are emphasis on improvement in personality $ were de 
marily as a teaching instrument. Five new experimental sca r analysis 
veloped by Darley and McNamara (50) on the basis of A e an 
Appli .to test and retest performance on thirteen existing an s reache 
adjust scales. The numerical high point in factor analysis rs in 
by Brogden (48) who made a factor analysis of the character s phases 
volved in the scores of forty tests purporting to measure onto , 
of character, intelligence, and personality. No one has yet pe factor 
however, the correspondence between the traits which come out 0 
analysis and the personality patterns of individuals. 


Critical Appraisal of Personality Measures 


aluativ? 
The approach to the study of personality through tests of Ceview 
attitudes has proved its worth, according to the comprehensive w self- 
this type of test made by Duffy (52). When certain other D as ^1 
estimate questionnaires have been subjected to realistic validato qus 
Bonney (47), Dudycha (51), Ryans (55), and Wile (56). of Bonne 
errors of judgment have been found to be extensive. The findings wath gr d 
(47) are welcome, if not reassuring. The reports of fifth- and ae atten 
pupils on their absences, library book withdrawals, Sunday-scho vá we 
ance, and weekly spelling scores for one semester, when comp? perc 
the actual records, showed an average complete accuracy of only te seem” 
and an approximate accuracy of 43 percent. Accuracy of estima 1 
not to be related to chronological age or I.Q. A individ"^, 
Additional evidence of the inaccuracy of self-appraisal in 253 10. seh 
cases was presented by Ryans (55) on the bases of his analys engl * 
scores and self-ratin 


D 
; 5 a rect m 
£5 on a five-point scale of items on (a) cor cot 


ne 


eading ", at 
usage, (b) effectiveness of English expression, (c) speed ghe exte 
prehension, (d) understanding of difficult reading materials, wledg? 
of vocabulary, (f) 


general cultural knowledge, and (g) kno 
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curre: i i 
ear See Self-appraisals, in the form of group averages, were 
pinion ge individual errors of judgment were j in 
iy of ele (56) obtained experimental evidence of the lack of valid- 
fron ime ` iy jen by comparing the diagnostic statements derived 
decd clic m hods of personality study with the case records of one hun- 
playing nda em and with items determined by the chance selection of 
Sree np enda e percentage of correct statements derived from the chance 
high or higher than the results obtained through several methods 


alle 
ged to have true diagnostic value. 


Bibliography 


- ALDRICH 
1 ay 
, Jurian C. “Use of the Interview in Education.” Scholastic 3 


ber 15, 1941 
VDER: PT » " 
son, A. C. "Interviews in Social Studies." School (Elementary edition) 28: 


Bees November 1939. 

Social TUE ALBERT B. “The Choice of Words in Poll Questions. 
I Biante 25: 12-18; September 1940. 

sNSHIP, ALBERT B. "Pre-testing à Questionnaire for a Public Opinion Poll." 


Soci 
Boni BU 3:263.69; July 1940. 

, Donornv Ann. Contribution of the Interview to Vocational and Educa, 

] Questionnaires. Master's thesis. r 


9: 1; Decem- 


” Sociology and 


ap wn on 


ti ; 3 
PEA Diagnosi by Means of Tests and 
WLER, Ex ark University, 1940. 77 p. (Typewritten.) . 
18:23 6. PE SHUMWAY. “Start With a Questionnaire.” Practical Home 
CANTRIL un 72; September 1940. i ge 
Quartal ADLEY. “Experiments in the Wording of Questions.” Public Opinion 
8. CuReToN T 4: 330-32; June 1940. 
esearch (RET K., Jn. "Philosophical or Group Thinking Method of Research." 
„and Re uarterly of the American Association for Health, Physical Education, 
Bio pe ee Dis ois October 1940. 
1l nal oj A ris E. “All or None Versus Graded Response Questionnaires.” 
D: Chesca AREER Porch olus 40513; June 1939. 
for Stude owarp, and KNOWER, F. H. “Analysis of a Guidance Questionnaire 
u ber 1940, 5 of Speech." Journal of Experimental Education 9: 175-76; Decem- 
UE dc T 
abili: ,Joux G. “Characteristics of the Quest f Depend- 
12, ENING. Journal of Consulting Psychology 9: 164-69; July-August 19 i 
Acade Joun G. "The Questionnaire 25 f Resear ” New York 
13. onnson A of Science Transactions. Second Series, No. 5. 1 1940. 28 p. . 
48: 600 Wituam H. “Technique of the Individual Conference. School Review 
14, : 600-605; October 1940. " 
: Observation, Ques- 


omics 


* Jour- 


f Investigation 


00s, LEONA 

ti EONARD V. “The Specific Techniques © 1 a 

"inaire, and Rating.” The ie Teo ife Movement in Education. Thirty-Seventh 
for the Study of Education. Bloomington, 


earbook, P. E e 

Ill.: Publi art II, National Society h 

15. Lent Tublic Sato Publishing Co, 1938. Chapter 31, Pr 375-90. i 

16, the R Hropore F. “Reliability of Opinionaire Technique Studied Intensively by 
- Lewis cien Method." Journal of Social Psychology 5: 339.64; August 1934. 

» James A. “Dowagiac High School’s Conduct Questionnaire. Clearing 

a. Master's thesis. 


y Hou " 
V see 9 13: 367-68; February 1939. -agiye Dat 
uestionnawe 


WIS, V 
18 ni E Howarp. Accuracy of Teacher Q 
* Linguist. gi C.: Duke University, 1939. 124 p. (Typewritten-) 
19 tional P, Everer F. “Sampling in Educational Research. Journal of Educa- 
à sychology 31: 561-74; November 1940. " 
i i ucational Research. Boston: 
s in Sam- 


Linp 

QUIST, E 1 
Houehro VERET F. Statisti ly: in 

plio Shton Mifflin Co ae A hapter qd; «Fundamental Concept: 
20, 1 pling Theory,” p. 129. | i 

RG, GromcE A. Social Research; 


ew Yi 4 
ork: Longmans, Green and Co-, 


A Study in Methods of Gathering Data. 
1942. 426 P- 
539 


. XII, No. 5 
Review or EDUCATIONAL RESEARCH Vol 


x : -73; Septem- 
21. Merritt, Doris P. “Pro’s of the Interview.” English Journal 30: 569. # 
d 1941. : the Gen- 
22. ME. University or. Report on the Personnel Research ue Ps n 
li eral College, University oj Minnesota. Minneapolis: the University ab 
1939. (Mimeo.) " saci Togrnabid 
23. Moonz, CLARENCE CARL. “Increasing the Returns from Questionnaires.” Jo 
Educational Research 35: 138-41; October 1941. 
24. Nzpnasn, J. A. “The Reliabilit 


l : : 69.73; May 1934. 
tudes.” Proceedings of the American. Sociological Society 28: 69-73; 1 
25. 


y Social- 
. OUTLAND, GEORGE E., and Jones, L. T. “High-School Pupils Evaluate the 
Studies Program.” School 


26. Pace, CHARLES R, “Factors 


^ 939. 
versity Students.” Journal of Applied Psychology 23: 388-97; June 1 
27. PHILLIPS, MARJORIE. “Problems of Questi 


soe,” Edu- 
: H es. 
28. Rew, SEERLEY, “Respondents and Non-Respondents to Mail Questionnair 


T 1942. 
cational Research Bulletin (Ohio State University) 21: 87-96; Anil 1 tember 
29. Rosinson, Bruce B. “Right to Protest,” Education Digest 7: 52-53; 
1941. : ue Waves.” Jour 
30. RoLuiNs, Marcorw, “The Practical Use of Repeated Questionnaire 
nal of Applied Psychology 24: 770-72; December 1940. " 
31. Rosrow, SYDNEY, and OTHERS. “Consumer and Opinion anon 
Siudies on the Form of the Question.” Journal of Applied Psychology 
une 1940, 


5: 
DE rterly 
xn Rucc, Donan, "Experiments in Wording Questions." Public Opinion Qua 
2; March 1941, 1 of Higher 
33. Sch o nawwER, Prep M. "Use of the Personal Interview." Journal 
cation 12: 387-88; October 1941. Returns to 

34, SHUTTLEWORTH, FRANK K. “Sampling Errors Involved in Incomplete tober 41 

Mail Questionnaires,” Journal of Applied Psychology 25: 588-91; Oe ica 
35. SLETTO, Raymonp F, “Pretesting of Questionnaires.” American Sociolog 

view 5: 193-200; April 1940. ns." Jour 
36. Stanton, FRANK N. “Notes on the Validity of Mail Questionnaire Retur 

nal of Applied Psychology 23: 95-104; 
37. Sucuman, Epwarp A 


Journal of Applied Psychology 24: 758-69; December 1940. Educt 
38. S ; esearch on the Interviewing Process." Journal of c 
tional Psychology 30: 34653; May 199% College Re 
" NS ORE ents Rapport in Interviewing.” Teachers 
40. Symonps 


s 1 
Experimenta’ 
ets 33446; 


” 
ires? 


in the 
:anons ID 
RICH, DoNarp H. “Effect of Mr A normal 


di- 

h (E 

41. Toors, Hrnprnr A, 56 uestionnaire.” Encyclo edia of Educational Researc 

ted by W. S. Monroe). New Yoi., Macmillan Co tear pra uds, BO 

42. Wert, James E. Educational Statistics. New York: McGraw-Hill Boo! 
Chapter 9, “Sampling,” P. 136.62. 

43. WiLKINs, Witam D. 


Sw, gdut 
„and Kennepy, I EO. "Psychology of the Interview. 
tional Trends 8: 18-23; í J ` à 


3 January 1940, jk: Pre 
44. Younc, PAULINE V. Scientific Soci l Research. New Yo 
tice-Hall, 1939. p. 139.75 7^ ociolo£y Surveys and Rese w+ Journ of 
45. Younc, Pautine V, “The Validity of Schedules and Questionnaires. 
Educational Sociology 14; 22.26; September 1940. 
Bibliography on Recent Personality Tests publi¢ 
46. BAKER, H. J. Detroit Adjustment J, ne 


nventory, Alpha Form. Bloomington, ? 
School Publishing Co) Joa digas ong Peychologit] 
47. Bonney, Mert E. “The Validity of Certain Techniques of Gathering Ps¥°™? coc 
Data, with Special Reference to P. 
Psychology 13: 103-22; Feb; 


540 


December 1942 QUESTIONNAIRES, INTERVIEWS, PERSONALITY SCHEDULES 


48. Bnocpew, Husert E. “A Factor Analysis of Forty Character Tests.” Psychological 
Monographs, Vol. 52, No. 3. Columbus, Ohio: American Psychological Associa- 
tion, Ohio iversity, 1940. p. 39-55. 

49. CLank, W. v tee Wi DA eons, L. P. California Test of Personality, a 
profile of personal and social adjustment. Intermediate Form A (Grades 7-10). 
Also Adult Series Form A. Los Angeles: California Test Bureau, 1940. 

50. Dartey, J. G., and McNamara, W. J. “Factor Analysis in the Establishment of 
New Personality Tests.” Journal of Eductional Psychology 31: 321-34; May 


1940 : 
51. Dupycua, G. J. "Self Estimates and Dependability.” Journal of Social Psychology 


12: 39-53; August 1940. . 
52. Durry, E. “A "Critical Review of Investigations Employing the Allport-Vernon 
Study of Values and Other Tests of Evaluative Attitude. Psychological Bulletin 
37: 597-612; October, 1940. "— i 
53. H j i N . C. “A Multiphasic Personality Schedule 
ATHAWAY, S. R., and McKINLEY, r caule" Journal of Psychology 10: 249-54; 


(Minnesota) : I. Construction of the 
onality Growth. Book for Junior and 


54, Mee Woe. H J. P. My Pers 
j ALL, W. A., unc, J. P. My 2 á 
Santor High D ag A and Adult Groups. New York: Bureau of Pub: 
ications, Teachers College, Columbia University, m Siati E 
55. Ryans, DA irst Step in Guidance: Self Appraisal. Publications in 
Peu E [d rh Series 3, Vol. I, No. 1. New York: Cooperative Test 

Se i " » 7 
56. Wie 18. “Chase in the Validation of Personality Tests.” American Journal of 


Orthopsychiatry 12: 154-61; January 1942. & 


541 


CHAPTER VII 


sas 1 
Test Development: Statistical Aspects 
NICHOLAS A. FATTU 


as ither 
For ras peron reviewen the large number of piublicanonn M os 
directly or indirectly related to the statistical aspects of test à e ian 
ment, made it imperative that severe restrictions be imposed on ee ‘other 
of the following discussion. Correlation, analysis of variance, an acts 
techniques were not reviewed unless they happened to relate i celal 
It may be observed that although the greatest frequency of pub = 
was found under factor analysis, the studies apparently show!ns der 


. : " . ur 
keenest insight in terms of analysis of basic concepts appeared 
reliability. 


Bibliographies and General Discussions 


gan 
BS Tn arrestricted manner this review continues the previous one by eek 
(24) jok (9) and Potthoff (52) gave general discussions of er a 
ment testing. Horst (38) considered the logical bases underlying gi- 
testing and especially personal adjustment. Dunlap (20) presented a paon " 
fied bibliography of statistical developments over a three-year PE by 
and concluded with a summary of certain statistical errors 2 nnua 
psychologists. Swineford and Holzinger (59) continued their ? 
summaries of statistical developments. Weidemann (62) ipi 
conflicting evidence concerning the inconsistency of measurement vá 
by essay as compared with objective studies. Jackson and Ferguso te 
discussed studies of the concept of reliability. Though not pr e 
test statistics, the Journal of the Royal Statistical Society has PY”, 936 


a rather comprehensive annual bibliography of statistics since 
largely under the direction of J. O. Irwin. 


ated 


1 


Factor Analysis 


‘ c that 
The popularity of factor analysis methods is attested by the fac 2: 


er 
the greatest frequency of studies was found in this area. A num 


10 
devote ohn 

1 Statistical methods are treated also in Chapters IV and VII of the present issue; chap ows: oli 
statistical methods have previously appeared in the Review or EDUCATIONAL RESEARCH E Februar? Poe 
C. Flanagan, "Statistical Methods Related to Test Construction and Evaluation.” 9: 109-30: tel: eit 
(Karl J. Holinger, "Factor Analysis," 9: 528-31, 619-21; December 1939. Douglas E- si n 
Numbers and Related Composites.” 9:532.42, 622.25; December 1939. J Palmer O- Johnson, , 9 585 
Methods. 9: 543-54, 626-29; December 1939, T Max D. Engelhart, “Classroom Experimentation: Meth, 
629-30; December 1939. | Edward E. Cureton and Jack W. Dunlap, “Developments in Sta ic K" 
Related to Test Construction. 


t 
a Frederic, Kosen 
8: 307-17, 357-62; June 1938. § Herbert A. Toops, and $ Ruchi "P Gee 
“Test Construction and Statistical Interpretation 


et 
5:229-41, 309-14; June 1935. G- M treatment 936, 
Developments in Statistical Procedures.” 3:33.40, 65-72; February 1933. § Additional ) ; December.) 
curred in the following chapters: December 1938, Chapters V (Frutchey) and VII (Scates MEC La 

Chapter III (Lindquist); February 1933, Chapter II (Osburn); and October 1932, ChaP' 
Editor. 
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There was an increased emphasis upon 
and an attempt to reach some kind 


a among the various methods. Increased ease of computation 
iri a. sought with some success, and more nearly adequate tests of 
uds — to be in the process of incubation. As usual, the 
ipe app qois of the method formed the modal type of study. No 
d E of factor analysis were found in the educational field. 
Sudipate at e attempts to synthesize the various factor systems and to 
Burt (2), se each might be used appropriately were the publications of 
ond B , Holzinger and Harman (35), and Swineford (58). Holzinger 
d Harman (35) considered the various types of factor analysis and 
ponga out the desirability of separating the statistical aspects from the 
rie in ina particular field. They gave a discussion of statistical criteria 
ike T = a choice of form and method, and prepared a compilation of 
bifacto, ing factor systems. Swineford (58) compared multifactor and 
fa OT analysis. Burt. (2) emphasized the essential similarity of all 
ctor theories and all methods of factor analysis, a contention he sup- 


ported with data on temperament types. Burt urged that factor analysis 
hematical method. Logically, 
d 


a regarded as a logical rather than a mathematic ] 
" insisted, factors were principles of classification which sp 

Fino of relations..A factor was valuable because it enabled uss old 
ah pies a definite but complex pattern of characteristics. For he 
Car xcellent illustration was provided by two studies of verbal ability. 
roll (3) confirmed Thurstone's M. but V was split into three factors, 


and W was split into two. Johnson and Reynolds (43), however, found 
sely related, if not identical with, 


t 
bens which appeared to be clo 
Oth one's W and V factors. M» 
"i er developments were Horst's (37) method for trans pues an 
enti rary factor matrix into simple structure by a method which isa most 
Mo objective; Coombs's (10) and McNemar's En T 2: 
eria eur rs to be ex racted; an 
ae ig He” w ar a between two tests 


"erguson's (21) indi 2 a i difficulty 
tion that differences ! i 
lee RT in the factorial configuration a$ addi- 


Or two test j 
R items were represented i : 
^ nal factors suggesting da if all tests included in a battery were inet 
“eee with reference to difficulty, existing hierarchies would De 
;Q meaningful. Gui ht out the same 
i . Guilford (30) brought ou s n | 
bral cage ene of item might measure different abilities 
oe as it was easy or difficult for the individual. General discussions 
actor analysis were given by McCloy (45) and Ee (3 ) : 
Ne ven discussions of tests of significa thy 3 sites y 2 
in ar (46) reported that three empirica ox N08 Ac 
wi showing that sampling behavior of tne first centroid factor toa ing 
a . ! ; 
De d like that of correlation bus c ans ergo 
| for loadings beyond the first were jstressing!) : g (6 
in oe bs method of maximum likelihood to the problem of estimation 
actor analysis. In a special case he observed how test fallibility en- 
543 


ng seemed to be discernible. 
e logical implications of factors 


e wor 
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A unalities 
tered into factor determination, and that the method of — 1 pile 
underestimated the number of factors. It is hoped that Young 
tinue his studies to include the more general case. 


Reliability 


: sing 
Especially noteworthy among studies of reliability was nd Ii 
substitution of an analytic rational, rather than a crude empiric ci were 
on the basic problems and concepts. Outstanding in this e ad. 
the studies of Hoyt (39), Jackson and Ferguson (41), and Kelley pm 
Kelley (44) defended the traditional odd-even reliability psc 
and indicated that it was a quantitative statement of an act of ju = he 
that the things correlated were similar measures. It was Ep were 
Kuder-Richardson formulas ignored this act of judgment that it halves 
inadequate. Kelley argued, further, that it was less severe to SP 1 e same 
than to draw up items in the first instance which measured th 
function. ability: 


Though he questioned the Kuder-Richardson formulation of refnition 
Kelley considered the idea important in connection with a CC irpost 
f the. "coefficient of coherence"—a measure of the singleness of omplete 
of ulis. constituting the test. Kuder and Richardson assumed c Jation 
unity óf purpose when they assumed a rank of one for their bent rox- 
matrix of test items, but Kelley thought it better to measure actus p 
imity to a rank of one by computing the “coefficient of coherence. (41) 
In a penetrating analysis of reliability, Jackson and Ferguso” f 


irs A e ‘ors 
showed that reliability may be interpreted with emphasis on €797'; 


: in 
on a. ssing 
measurement, on stability of scores, or on sensitivity for asse ;abilitY 
dividual differences, T 


elia 
hey would abandon the blanket term Curse 
in favor of more specific estimates of absolute and relative “a be 99. 
measurement. Estimates of reliability, they suggested, could bes 


3 R š i uence | 
S of variance since it separated the inf utatio” 
errors, practice, individual differences, and facilitated the comp 

of Jackson’s measure of sensitivity. arable 


Several experimental studies were cited to show that retest, con hardso™ 
form, and split-half reliability were not the same. The Kuder-Ric the 
measure, they indicated, was basi 


A ereas 
ed upon internal consistency W te 
usual definition implied agree 


en 
To find the most reliable co 
of combinatorial analysis was 


ment between two sets of p ay 
mbination of a group of tests £ sts Y ill 
described. Those who work with te= 
find the "Suggested Test Report” (41:104) of considerable pergu” 
Similarities and contrasts between the Kelley and the Jackson- formt” 
discussions may be observed. Both criticized the Kuder-Richardson form 
lation of reliability. Kelley would retain the traditional ue and 
whereas Jackson and Ferguson would substitute measures of abso tion of 
relative accuracy of measurement. Both indicated that the assumP ould 


H * e 
a rank of one for the correlation matrix was untenable. Kelley 
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evaluate the rank by his “c 3 
"eun showed thet the AM et ipee ques ile Jadson enn 
i Á ut unnecess 
Beetle ud agrees with Jackson and Ferguson e is 
a aa ae the analysis of variance for obtaining more 
as eae ns, ee also recalls that it was Jackson (40) himself 
field of oi inst the adaptation of methods from agriculture to the 
in a jm Ron ee making modifications to fit the new conditions 
Domo E me [ iem arguments appear, by analogy, equally cogent 
a s ypotheses. More explicitly the linear hypothesis 
shel m a ns o acconnt the important aspect of measurement de- 
error effect: ( à D except to describe a lack of it as a biased error or 
Vs sever và rs ] 5 This assumption seems somewhat indefensible since 
specify a sonal escribed in terms of the measures themselves. We can 
nor Ere seitdem p confidence range at any level of significance and yet 
of measur y. alidity is more than a biased error. Bias and accuracy 
ement logically show some degree of interaction. Knowing the 


amount of bi s 
Í bias will be of no use unless the extent of interaction of the 
o known. It is this lack of con- 


las wi 
si Same E e of measurement is als 1 
clown finem e aspect of validity that leads one to question that M 
Hoyt’s (39 son formulation 1s the final answer. 
of interest ) use of analysis of variance to compute 
st. In Hoyt’s method the numerator of his ratio 


tio 
n of the reliabilit " = Suis W^ inder" 
Square, Dividin: ity was "among individuals” minus “remain er" mean 
iding this by “among individuals” mean square he got reliabil- 
he got Jackson’s gamma 


lty, rg. i 
5 ded gro it by “remainder” mean square 
sistency) Apparently the difference between reliability (internal con- 
one esl ierakesl by fin squared was the difference between two yardsticks— 
ther ctudie pierres the other in qua 
48 to show i which should be cited are: Casanova 
Variables į s effect, upon the reliability coefficient, 
involved in its estimation. Clarke (7) indicat 


accur, : 

ac X 1 s . . . 

acy in examinations was set by the inconsistencies of performance 
o quantify the function by his 


of th 2 
coefficient individual and proposed t i 
uder-Ri P ubiquity.” Dressel (18) gave another derivation of the 
: chardson formula, and Mosier (51) used it to derive a formula to 


Simplify ; 
plify its computation. 


reliabilit lso 
for the determina- 


rter inches. 
(5) presented formu- 


of changes in the 
ed that predictable 


ei 

resulte p (53), in a series of empirical studies. achieved inconclusive 

tationalizatic Ferguson’s (22) discussion may be said to represent a 
Y Carter ion of the problem. Some other empirical studies were reported 
(29 "'** (4), Cronbach (12), Drake (17): P plich (26), and Guilford 


Validity 
ecoming increasingly 
n of results may 


future. Weighting 
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The 
fa 
ct that test makers and researchers Were b 


are 

of : : 

Serve to a La problems of meaning and interpretatio 
increasing meaning to their results in the 
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ids ince all 
and item analysis may be considered as phases of validity sin 

eventually aim for maximum agreement with the € weighting 
Richardson (55) gave a comprehensive discussion oa 7 variables 
problem and indicated that the choice ofa method of com enis to have. 
depended upon the properties which one wished the ee in all cir- 
Naturally there could be no single best method to be y^ connor 
cumstances. He indicated the properties of several of k dd be made 
used methods of weighting. In this connection mention eges terms © 
of Rulon’s suggestion (56) for using test scores regresse 1 duces the 
their reliability instead of actual scores. Such regression ee sensible 
variability of the test scores and gives a result which is n owever, 8 
than raw scores, so long as one works with a single test. If, ilit these 
composite is to be made of several tests one should nót ii z-scores ; 
regressed scores inversely as their standard deviation (to P ide scores 
for to do so would be to assign the greatest weight to the least reli that lac 
Within this area, as in others, illustrations abound to at terms 
of mathematical training among psychologists reflects itsel utiohs are 
partial solutions to problems where relatively complete S who use 
possible. An example is the study by Forlano and Pintner (25 s which 
2 irical method to determine the percentage of the total pet 
mui taken at the extremes of a distribution in order to get tributions 
differentiation, They found that even for moderately skewed distr wou 
ed satisfactory. An analytical solution of the problem = 

the exact percents for the various levels of skewnes 


F : ‘ Jation 
Some methods of item analysis which considered only the re 7 
the item to the criterion 


and Guilford (29), Too 
which considers the rel 
(32) presented an inte 

Psychophysical met 
(23) and Mosier (50) 

Thomson (60) follo 
a period of succe: 
type of item as it 


and to scaling by Grossnickle (28). test 0V™ 
wed individual items of an intelligence p the 


Scoring 


Hartog (34) ar: 


jor 

super si 

gued that he had empirically demonstrated a ns 
educational value 


. ositio 
and reliability of grading for English qu fe 
written with a given audience in mind than under the usual P 


: z " ination- . 
Weidemann (62) continued his studies of the essay eeepc d zs 
Deemer (15) Suggested criteria for estimating tolerance H D 


x i law. She? "por 
ing errors per paper, when these errors obeyed the Poisson nalized 4, 
contended that the more cautious subjects were unfairly pe correct » 
their omissions on matching tests and proposed a formula e: Bayt. 
effects of guessing. Colandra (8) in a theoretical vias et ter 
theorem as the basis of a general equation for scoring obj 
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The limitation 

s of Baye’s theorem and the increased scorin diffi 

H H H E l 
make the application of little practical importance. E a 
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CHAPTER VIII 


Tabulating and Test-Scoring Machines: 


Applications of International Business Machines 19 
Educational Research 


IRVING LORGE 


Any REVIEW of the literature on applications of machine methods a 
tabulation, computation, and test scoring at the present time will be 1n 
complete and inadequate. Many applications of machine methods hars 
not yet been given formal publication. The present review will be Ru s 
to the machines developed by the International Business Machines e 
poration and to applications of those machines to educational researc” 
No single book covers the variety of machines available or the varien 
of applications possible. It is hoped that the long promised (since ^" 
"cation on “Questionnaires, Standard Codes, and Hollerith Machine? 
ai. Toops will be published soon. 
V ue aM machines include a large variety of punches, sorters, 2 » 
Ing machines, auxiliary machines, and special devices. The less well-know : 
machines are the alphabetical interpreter, which prints punched inform. 
tion across a card; the collator which compares two sets of punched ee : 
in order to match them or merge them; the duplicating summary gu 
* the gang summary punch; the automatic reproducing punch; and thee rice 
matic multiplying punch. Some special devices are the cross-footing °% 4, 
which makes possible computations such as E = [(A X B) + C c 
the card cycle total transfer device which enables speedier summat? ro- 
cumulative sums; the card matching device for selection of specifie P 
files; the digit selector particularly useful for item analysis; the ne 
sensing device which punches data into punch cards from pencil mar n£ 
and the test scoring device for grading questionnaires like the ab e 
Vocational Interest blanks, In addition, the IBM machines include ati 
test scoring machine with its graphic item counter and the aggre’ 
weighting device. : 1 
The machines, in general, make for greater speed in recording: ^^ at 
fying, and tabulating data, and in computing statistics. Because n ES 
speed; the availability of data makes for greater statistical control © ting: 
variate background data and extends the possibilities of research reP v 


ccount- 
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General Books and Articles 


„ag 18 
The basic reference in the applications of punched card machine’ e$ 
Baehne (2), which includes chapters on the development and p ys! 


z : ; ista 
of Hollerith machines (Arkin), on applications to work of Teg" 
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(52) 
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* machines 
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Gne of ^ 

th 


in relation, 


» 69 
an es 
al n p 
nnotated partien K 
logra te 
Braphy HH t 


*quipm 
ent other than the IBM (82)- 


Sta " 
tistical 
Appli 
y lications 
s the method of arriving A 


Si 
nei 
Sum € the basic à 
operation of the tabulator i 
he summation method of 


S and 

ürriy; cumulati 

t ms at the 25 sums, an understanding of tl 
by arliest appli ues of XX, XX, and so forth, is indispensa® "* 
cation of the summation method with digiting was 7»? e 


C Dp 
eos C Duna 
opm ap (12). The earliest references to the use of punched card 
lation was made by Smith 


(7 ent f 
D. or correlation and multiple corre 


isticians (5, 76, 
d greatly €*- 
kground for 
lative multi- 


Th 
^0 87 ga digit 
n 

tended i ng shall wae popstar e 
the e by bum method was redise 
pli, MPUtation ps who summarize ical bac 

tive x endenhall moments with cumu 

to Loms and di and Warren (58, 88) utiliz 
4 Svs avens for T for getting correlation coefficients, 

re * of the e digiting process (49). Dwyer 18) illustrated the 
m d machin i isti 
! es to compute the various statistics that are neede 


Ww a 
table 7 and 

Meacham (20) demonstrated how to c 

it selection; Milliman (59) in- 

i W. Dunlap 


dic, 9h th 
al et 
ing may be accomplished without sorting; 
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repare correlation 
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leviations; 
(13) showed how the machine can compute means, standard d 


? de- 
‘and correlations with positive and negative numbers; Dabo. CO 
scribed how various statistical processes can be done on the car ^ hed on 
sorter; Kuder (46) revealed how correlations can be aes cmm the 
the test scoring machine. Dwyer (19) and Meacham (57) Sa HY. XY, 
collator for pulling prepunched cards with data in form X, : am ‘tabled 
and so forth, to compute moments, product moments, and any 
function. i ical for 
Dwyer (17) pointed out that the Hollerith equipment is o rchanb 
ve or more variables with cases in excess of 250. The Friden, variables 
and fully automatic Monroe are more economical for four or less va 
with cases up to 250. 
McPherson (54) gave the background for the mechanical tabu 
polynomials for which the machines had been adapted (89), Se in an 

(68) accumulated cubes directly from punched cards and Feins e if- 
Schwarzschild (26) used the machines for automatic Diu 

ferential equations, Hartkemeier (33) showed how differences 
obtained from punched cards. to quam 
Fla the computation of item validity data, Tucker indicated how ptainins 
(Utributes (84a), Royer (66) demonstrated the steps for 1D. Stal- 

c gorrelations, which were somewhat extended by DuBois ( 


A ifficulty 2? 
1/3) adapted the tabulating machine for computing dien P gt 


7 perce” 
validity indexes; Flanagan (29) used Kelley's upper and lower x AO 


for getting estimates of biserial correlations and difficulty ; Lindquie vice 
obtained percents through cumulation of reciprocals for each poa basic 
on a test, a technique also used by J. W. Dunlap (14) for getine, dkins 
data for estimating the value of tetrachoric correlation coefficients: Jectin’ 
(1) suggested applying the 


se 
machine for Toope's L-Method of he 

items, and Flanagan (28) 

earliest use of the machines 


lation e 
ndomire 


ons. 


rugs : jati 
for approximating regression equa? tha 


A * aps 
Tor regression equations was perhay 
Segel (70). 


apted Rulon’s procedure for estimating 


coeflicients, and Stalnaker (74) noted the computation of 


integral values of X. 

In factor analysis, Tucker work 
(84), a methed of gelting Thurs 
cards (85) and graphs 


pipt” 

B rix mu 

ed out an approximate matrix a pune d 
n A H a 

tone’s centroid technique fro! 


for the factor patterns (86). 


Coding and Card Forms i atio” 
inca", 

The value of the punched card methods depends upon the € ll 

and coding of the classifications adopted. Research workers W! lemen? 4, 
that the coding-classification step is one of the more important € e mad 

analysis. One of the most significant contributions to coding W ing the 

by Dunn (16) in his utilization of the geometric code for exten " 


nc 
2 ing C? 
capacity of a punched card. Toops and Rover extended coding 

P p I 3 
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[CUR een with reference to the uniqueness of the geometric code 
, 67; 78, 80, 81). Edwards (23) has shown how coding is a necessary 


ante : 
cedent to analysis of medical research data. 


Berk 
T een E developed an interesting punched card form for written 
hed data. The punch operator punches directly from the written 
punched. Crissy and 


data whi 

doce d ae always in view on the card being 

to deciles ) adapted the punched card for recording status with reference 
on various tests so that a profile can be developed. 


Statistical Controls 
Ever si m ; 
since Toops (77) indicated the need for statistical checks on data, 
roduce automatic or semiautomatic 


th a 

rim er iig attempted to p 

Langriuir | jim One of the most significant contributions is that of 

culation. B. 8) on controlling errors in tabulation, card counts, and cal- 
. Brandt (6) indicated the effect of coding on calculations and 


ihe 
heir corrections. 


Scori 
coring Methods on Punch Card Machines 


In psyc 4 
psychology and education, scoring (particularly of multi 


1L 

due been a laborious and time consuming process. Wood s 

more iti a the Strong blank has made work with it and te&? 

Counting m 1. Bedell (3) achieved somewhat the same result on the ca 

ing item —- 2 and Rock (63) on the tabulator, particularly for develop- 

the mask ights for such tests. Toops and his students (41, 19) developed 
card in scoring multiple choice tests and in securing item analyses. 


(64) also used the Hollerith for scoring tests. 


Test 
Scoring Machine 
test item and the re- 


90). The items have 


Tieas 
scoring machine implies an adaptation of the 
n type. Very 


Spon 
to DNE to the scoring machine (24, 44, 45, 41, T 
ew “ihr wei form and tend to be mostly of the recognitio 
sheets as MENU, however, have questioned the use of ae deu 
and Bord with direct response in the test booklet. c g 
type. Tinsley, (51) found the machine scoring form 
to take the er and Hilkert (83) noted that students w. 
Who had t ‘enl booklet with its answer sheet on a table di 
finding Ww : manipulate the booklet and answe 
a proved B statistically significant in only one of seve or 
administr gc it will imply separate norms for different conditions © 
Separate ation, Dunlap (15) in an elaborate research has sh 
answer sheet does not affect reliability or validity of results. 


State n 
wide and Other Applications 


Th 
e * 
Ossihi 
the Po Rag for accelerating scori 
BM equipment has been Te 


i ting with 
ng, reporting and computing "* 
testing 


alized in many statewide 


g 5 
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1 ave not 
programs (38). Some of the many applications and pes iral given 
been published. Illustrations of the flexibility of the 5 scien (15) 
by Feder (25), McQuitty (55, 56), Mosier (60), and Stro - do most 
Cox utilized the equipment for research and student guidance, 
of the testing installations. scamming 

Pinkus (35, 61) adapted the machine for high-school progre nua d 
a large urban high school, and Hall and Henderson (31) i 
the success of teams in judging cattle and crops. ting, and test 
With the impetus given to speedy test scoring, test repor F^ Marine 
analysis by the classification workers in the Army, Navy, ill continue 
Corps, new adaptations of the machines have been, and H rast ad 
to be, made. It is hoped that these applications and procedu 
published for the benefit of research workers in all fields. 
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vices" Ohio College Association Bulletin, No. 122: 2,0210; April 13, Pe ult 
93. TRAXLER, ARTHUR E., and HILKERT, Hose N. ec D IE ber D bi $ 
of Machi ts.” School and Society 9»: sii $e : d 
84. Tucker, pokey red de uris Multiplier.” Psychometrika 5: 289.94; December 


1940. p n 
84a. Tucker, Lepyanp R. “Note on a Machine Method for the Quant on) phos 
butes.” The Prediction of Persona (ean ^ $47.48, 
85. No. 48. New York: Social Science Research Council, 17%.. p. Dir ed Cards.” 
* Tucker, Lepvanp R. “The Centroid Met ) Libraries 1. 
86. Bibliofilm Manuscript No. 1623, University of Chicago il reds iy Machine." 
- Tucker, Lepyarp R. “Factorial Rotation 9 y Graphe, 
87 y Bibliofilm Manuscript, University of Chicago Libraries, ^d Machine Gales: 
+ Wattace, Henry A., and SNEDECOR, GEORGE ion ans January 1925. 
88, lation." Official Publication of lowa State College, Vol. 23, N BÀ W arren-Holle- 
- Warren, Ricuamp, and MENDENHALL, Rosert M. The Med D cd No. L 
rith Correlation Method. Columbia University Statistical Bu 
. 43 p- 


viation by Plotting and Without 
imental Psychology 


oring and 
n Bulle- 


res Trend Lines. 


ew York! Columbia University, 
i Gn Fe Col ierih Machine Computation od nde eau 
Columbia University Statistical Bureau Document, No. 4. es 
lversit: : ie a 
E iium ier di Frays of the Test Scoring Machine.” Personne a 
istrati, . T5. : a acie 
i Soci Bry D. A eae it S ea Scoring the Strong Interest Test.” 96 
Society 36: 718; December 3, 1932. 
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Reporting, Summarizing, and Implementing 
Educational Research 


DOUGLAS E. SCATES 


CHAPTER IX 
4 
How Should Research Findings Be Publicized? 1 

| 


How can the educational press help in making research effective in class- 
room practice?” This was the subject discussed by the Educational Press 
Association of America in its meeting in Atlantic City on February 25; 
1941. One speaker, thinking primarily of survey research, fact-finding, 
and general evaluation, noted the great need for large scale cooperation 
on the part of field workers and the importance of group action in follow- 
ing up the survey to interpret findings and see that appropriate steps 

-. were taken to set the forces of improvement in motion. He urged a greater 

zat of publicity for such studies before, during, and after their = 

Another speaker, thinking primarily of “scientific” research—de- 
iments, laboratory work, the analysis of causal factors an 
comet -¥ noted the slow progress of scientific knowledge, the explora- 
tory character of many investigations, the conflicting results of experiments, 
and the need for true scientific caution in accepting findings until they ha 

been verified by many studies attacking the problem from a variety ° 

approaches. He urged that due time be allowed between the reporting ^ 

a pioneer study and the adoption of practices in the classroom whic? 

devolved upon the new findings. Science has often been wrong. Much harm; 

both to children in the schools and to the esteem with which education? 
research is held, will inevitably follow upon the hasty acceptance of un 

tested research findings. d 
There is apparently more than one type of educational research an : 

more than one appropriate type of reporting. Certain undertakings un 

doubtedly need a broad base of social support; such are the studies whic " 
deal with problems that social action can handle. Certain other investi” 
tions need careful scientific Scrutiny and testing over a period of yea 
before they are ready to be thrust upon large groups with the admonition 
to accept them, for they are “scientifically proved.” Such studies yo 
to be reported in technical journals which will excite the interest of o! en 
workers competent to study them further. In due time they will be re ce 
for inclusion in yearbooks, textbooks, and teachers’ magazines. If oan : 
is not to mislead, it must be science—and not the results of some one ad: 
several studies made by workers having the same background of age 

No finding is safe until it has been critically examined and tested d 

workers with diverse points of view. Our efforts to have research repo? 

more widely and immediately should therefore be discriminating. 


558 


Decemb 
er 1942 
REPORTING EDUCATIONAL RESEARCH 


Need f i 
or Synthesis, Interpretation, and Evaluation of Research 


It may be that there are i TE E 

Venue e tc ag D 
ractice and in theory. Reports of Sessa l 5 rogress both in 

anu ch findings need to go thr 
et oe gem they are ready for ultimate use. Our pce 
al these unions Foe a possibly be weak in some one or another 
preting, alee g the line. Possibly more facilities for reviewing, inter- 
that with ce: and evaluating are needed. There is always danger 
nius gemmis a of enne and individual research centers pur- 
Sviithesizitun the € m ems, no one vill do the necessary work of 
whole which aut ious findings and weaving them into a “nonpartisan” 
Ta cilius ue T" meaning and value for the consumer of research. 
as the ens d Ed uc the facts that add perspective are as important 

Such an i fas i pa : i " " 

iestination pet: evaluating task is entirely different from the direct 
eliiition ani o results .of individual stu 
TES Ly ‘anes | eei ee “research 
relate, be o in producing research then 
rimis - | both theoretical and practic 
pens E pe is completed every year. The conclusions obo 
ME one iffer, but there is no reason for assuming th 5 Pe 
the individus] 15 research, would be any more in error than are tatty” 
‘alter'S Mo ements studies. Such a process was one of the goals of 
(52), when m in preparing his Encyclopedia of Educational Research 
add up to?” Ai each writer to teli, “What does the research to date 
OF Dh ce is discharged to a certain extent by the REVIEW 
of being L ESEARCH, though most contributors lean in the direction 
g comprehensive and noncommittal rather than in the direction o 


inter d 
ret i 1i 
preting, evaluating, and synthesizing. 


N " 
eed for Direct Study of Applications 


o view research findings from a background 
the needs of the practitioner than 


We 
also need persons wh 
c considerations of the research 


that i 
wi m. us somewhat more with h 
Producers Dou technical and scientifi i E 
if the ind uan work can often be effectively accomplished by committees, 
Cessions wes with different backgrounds are willing to make some con- 
t any rat the criteria of those who have opposing frames of reference. 
of its « e all must recognize that when research is to be applied. some 
apply Ea must be given up—at least for the time. The attempt to 
application OMSN ST lead to new problems demanding further study. Any 
actors, a n of science calls for a continuing adjustment between various 
cl ange. s one after another is modified or as general goals and purposes 
ation—study, 
tal principles 
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s sequence of 
the fundamen 


We 
may, for example, note thi 
io is based on 


int 
he case of radio. Although rad 
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of electromagnetic wave propagation set forth in mathematical terms by 
James Clerk Maxwell some seventy years ago, radio did not immediately 
spring into existence. Research on radio tubes is still under way, and i 
appears from the current full-page advertisements of the General Electric 
Company concerning its developments in electronics that a new area of 
possibilities has just been uncovered. And of course radio research must 
deal not only with tubes but with all aspects of radio—combinations of 
tubes, improvement of parts of the circuit, groupings of parts into new 
circuits, sound, adaptations to various purposes, market research, and so 
forth. It is probable that research on radio, both on the physical side and 
on the market side, will continue indefinitely. Even though radio as we 
think of it lies in the field of technology, the great number of problems 
which arise in the applications of the various scientific principles reve 
countless lines for “pure” research to follow up—lines that would other- 
wise never be dreamed of. We would have no science of electronics if we 
had not first had the radio tube. Pure science, when it is alert, profits Írom 
applications as much as does the consumer. The same condition holds o 
-research in education. The problems of application are as great as ss 
ems of original discovery—and are in the long run as stimulating 


ly just the change from small.scale to large-scale procedure? 
> new difficulties. This condition is well illustrated in medica 
chemistry by the early work with insulin. After the hormone had bee? 
discovered, had been experimented with both in the laboratory and in 
the clinic with highly satisfactory results, its manufacture on a large scale 
was undertaken. The results “were at first extremely unsatisfactory a 
disappointing. Indeed, for some months (in 1922), although every "i 
of the laboratory process was apparently being duplicated step by pe 
on the larger scale, it seemed impossible to obtain anything like p^ pn 
pected yield of insulin. It almost looked as if we had lost the secret © "o 
paring insulin. Some unknown factor had evidently crept in, leading It 
the destruction of the hormone during its large scale extraction. + * * — 
was several months before the difficulties were gradually de onn a 5fi 
It has since transpired that a chief cause for the difficulty depende tive 
inadequate control of the degree of acidity at certain stages in the EL we 
process.” The transfer of science from the laboratory to large-s¢# px y 
may be expected always to have attendant problems requiring further § 
and research. 


Examples of Research Summarization, Synthesis, 
and Interpretation 


The joint yearbook of the Research Association and th 
of Classroom Teachers (3) is a recent illustration of the summa 


itn © 
cine, Julius Siieglit^ 


rizatlo 


1J. J. R. Macleod. “Insulin to the Rescue of the Diabetic." In Chemistry in Medi 
New York: The Chemical Foundation, Inc., 1928. p. 304-305. 
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and interpretation of research findings for direct classroom use. It is 
the current counterpart of the Eighteenth Yearbook of the National So- 
ciety for the Study of Education, Part II, presenting the Fourth Report 
of the Committee on Economy of Time in Education, issued in 1919. 
Such reports are pointed toward the practitioner. 

The Encyclopedia of Educational Research (52) was an effort to pre- 
sent “comprehensive and critical syntheses of the results of educational 
research organized in a conveniently usable form. . . . It is the purpose 
to tell what the findings of research ‘add up to’ after critical evaluation 
and what this synthesis of findings means relative to educational theory 
and practice” (p. vii). The Encyclopedia stands about midway between 
the original research reports and the interests of the ultimate consumer 
of research. It is of service to both groups of users. 

In the general category of interpretative summaries of research should 
be mentioned the five-volume report now being published by the Pro- 
gressive Education Association (64) covering the Fight-Year Study of 
high-school and college articulation, and the final volume of the Amer- 
ican Youth Commission (6) summing up their several years of stud 

ther aspects of interpretation, involved directly in lupis toting E 
be discussed toward the close of the chapter. 

The 1938 Contributors Manual for the Review or EpUcs; yy 
SEARCH states that “The Review is to be factual, evaluati xls, pi 
gestive.” A chapter should include “A summary description of the T 
* + Setting or background, placing the research properly in its fie Mr 
Critical evaluation indicating weaknesses and strengths, . . a gen 
Overview of the field indicating the contribution of the research to prac- 
tical problems and to a developing generalization." The 1942 edition 
States: “The purpose of the Review oF EDUCATIONAL RESEARCH is X 
Teview—summarize, synthesize, interpret, and evaluate—current — 
In education.” As indicated previously, many contributors to the jon 
lean more toward a catalog of current research than a kae ed the 
Significance of research for practice is seldom pointed out; "gate bes 

EVIEW is too close to the original reports for this to be i unt fe 
Step. The Review is of primary service to students oF ot E to them 
undertake a piece of research in a field that is somewhat Dew a 
and to those who wish to keep abreast of research activities M à 


of fields in education. 

t will be noted from looking over interpretative syntheses that ay 
almost necessarily involve going beyond the data er Ls o ort. 
Beneral or more particular conclusions than the facts r a pede 
th © More the summaries attempt to interpret gain ids this is true. 

Ne further away they get from the original reports, he i d science"— 
uu 8 step is not to be shunned. It is one phase ES phon aspects of 
C7nology, Science itself deals usually with single, na ts of the 


: aspec! 
Fenomena; the practitioner needs to consider - rts of research 
‘ation in which he is working. Such practical interpret? - 
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are, therefore, to be regarded as approximations and, perhaps, as starting 
points for further study, when the results in the field do not approximate 
those obtained in the more theoretical work. By way of analogy, it is easy 
for physicians to destroy viruses in the laboratory, but they have prac- 
tically given up the attempt to stop or control a cold in one's head 
through the use of antiseptics. "In this case general therapy is more 
effective than local therapy," one is likely to be told. All syntheses of 
theoretical findings must be regarded as highly tentative for practice; 
the application usually involves difficulties which require that the theo- 
retical conclusions be restudied in the light of practical factors. 


Overviews and Compilations; Bibliographical Summarization 


There are a number of summaries which present overviews of cert 
research areas or periods, usually with some interpretation but with 
a definite attempt to synthesize into a general theory or point of view the 
findings of the research reviewed. Outstanding among these are the annua 
reviews of large research undertakings and implementing projects by 
Good (32) which have been published for the past five years. Good also 
4 uinared a somewhat longer résumé and orienting discussion (33). Scates 

prepared a brief overview of research for the past decade. Carr has 

phe seventh listing of Deliberative Committee Reports (20); 

2. 59 the earlier annual compilations are included. These lists are 

? ated and help give an annual picture of the findings and decisions 
of various committees that are working with educational problems. 

If we include those publications which merely select, classify, 
make more available the original articles, we should mention such per 
odicals as Education Abstracts, Education Digest, and the Loyola Educa 
tional Digest. There is also the work of the National Education Assoc!®” 
tion Research Service in publishing Education in Lay Magazines. Tm 
periodical was recently analyzed for a ten-year period by Hughes 
(43). A section of the Journal of Educational Research, “Research m h 
and Communications," edited by C. V. Good, is given over each mont 
i the publishing of news notes about current research activities. 
bibliographical services were treated in Chapter I of the present 


ain 
out 


and 


gviEW- 


P oc 
rocedures and Criteria for Preparing Technical Reports 


This section deals with the more immediate or detailed aspec were 


ports. Treatises on the preparation of research reports before 
covered by Good, Barr, and Scates (35: Chapter 13) with 12 ei 
and by Culver (26) with 62 references. Whitney’s 1937 text oF his rev 
edition (90: Chapter 16) includes about 50 references. Nine more ? arch 
brief treatments on the preparation of theses or undergraduate É dr 
papers are: (19, 23a, 24, 34, 36, 44, 61, 86, 94). Several papers 9^... re 
able forms in which to report statistical facts to businessmen: unum 

porters, and other consumers (11, 29, 45, 96) grew out of a Pr to 
of the American Statistical Association on this subject. One m 


ay wis 
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ow Dn Pa iode preparation of research reports in engineering 
y (56, 69). 

Various forms of citation for use in educational work are included in the 

educational treatises of the preceding paragraph. Forms of citation for psy- 
chological publications were discussed in three places (30, 46a, 83). A re- 
vised edition of the Government Style Manual (87) has appeared. The 
Leia See Manual of Style (23) has gone thru its tenth edition. 
i a ributors to the Review OF EDUCATIONAL RESEARCH were 
issued in mimeographed form in 1938 and in 1942. Other publishers have 
prepared form books and manuals for their own authors. For current list- 
ings see the head, “Stylebooks (printing)” in the Education Index. 
i Segel, in Chapter III of this issue, notes the need for specifying condi- 
tions and units of enumeration; and Blommers and Lindquist, in the closing 
section of Chapter IV, mention the need for clearer and more adequate de- 
Scriptions of the technical aspects of what was done, in reporting any 
Investigation. 

Popularized reports and graphing are di 
Tent references on reporting, one may see t 
in the card catalog of a library; Good's “Selective Bibliography, 
Methodology of Educational, Psychological, and Social Research, 77; 
IlI—usually in the September issue of the Journal of Edi 
search; and “Research, Educational: Techniques” in the Cx Tur 
Education annual Bibliography of Research Studies in Education. 


scussed in later sections. For cur- 
” 
on 


he head “Reports: Preparati 


Problems of Publishing 


E i H H 
valuation of Reporting Mediums; 
e to estimate the service 


uno statistical attempts have been mad estin Aa 
itin. particular magazine is rendering. Circulation is one pae 2? 
ieee Ung service and appeal. The number of persons who read each 
s mp: is a second index (35:126-30). The number of times articles in 
zi agazine are cited in articles appearing m other professional maga- 

nes is a third form of evidence concerning worth. Direct judgments 
?r evaluations constitute a fourth method. An analysis of the third type was 
je of several psychological periodicals some time i By a c 
ant (21) and has been done more recently for e Op via ks e 
evala by Wilkins and Anderson Ol, 92, 95). Aa i de oie E 
Eod LO based on frequency studies, considerable care pps 
and in drawing conclusions. Similarity or poscit A dur 
as ae between the periodicals cited and those ing ua a 
suc Filios the citing periodicals and the reader must be ug de 

Tequency counts have significance either in general or tor 


Prospective reader or subscriber. Steele (81) prepared a rating scale for 


00) h s 
fo ace op cae diet jon 67) in psychological 
ace: " 


ublicatio B E 

n lag was discussed in two P 

Masaz; 5 : 28). 
oid and was discussed in educational magazines by Donohue ( x 
Tophotography or microprint as a method of publishing res? 


treated in Chapter I. 
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Dull vs. Appealing Reports of Activities 


In recent years there has been something of a revolution in the public 
reports of the activities and statuses of school system and corporations. 


and 


If reports are worth making, they are worth reading; if they are to be 
read, they must have widespread appeal. So superintendents, business 
cluded that if their reports to the public or to stockholders are dull or 
not instantly comprehensible, it is the fault of the persons who get the 
been made much more appealing, usually thru the use of more photo- 
graphic or other graphic material, and through the decrease of tables 
commonly couched in technical or semitechnical terms and involved 
matters of far more concern to the persons in charge than to the common 

While we are not here intimately concerned with superintendents’ re- 

„ports, inasmuch as they cover activities and seldom deal with research, 
ployed. There are times when research could well afford to stimu- 
Sy and interest of lay people in its endeavors, its problems; 

: hay 
emort'to acquaint people with its detailed findings. Numerous current 
popular reports of medicine and physical science do a great deal to keep 
like school administration, is in need of taking time occasionally t° 
glorify its work and share with others the hopes that impel its workers 
couragements that often beset the explorer seeking something which, eve? 
after years of effort, he is not sure is there. 

3 A n- 
business managers' reports were reviewed at some length and with sp 
siderable clarity by Theisen (84). Arnold and Castetter (7) mention 

5 e 
raphy (2) on superintendents’ reports. We shall make reference her 
only to six articles commenting on the character and preparation 

. ts 

It seems appropriate to mention as examples four recent school repo 

The Springfield, Missouri, 1938 report (80) carried about 60 pe ci 

pictures and no tables, and was published “to give you as tax pay. 

= A con 

portance, and some idea as to the school’s responsibility for 2) The 

» (b 

Rochester, New York, 1943 budget (71) carries six pages of p ted I” 

captions, and paragraphs at the outset, and the budget is present 


managers, municipal governors, and industrial corporations have con- 
report out, for reports can be glamorous! Accordingly, many reports have 
and routine records of departmental work. The older reports Were 
reader. 
say nevertheless have occasion to consider some of the methods they 
(a uity and patience of its workers, even though it makes no 
these fields in high esteem in the public mind. Educational researc”, 
forward in their long, monotonous tasks and the difficulties and dis 
> 
The changed character and purpose of many superintendents 
y n iog- 
three more articles. Educational Research Service prepared a bibliog 
such reports (10, 16, 27, 46, 62, 72). 
which are conspicuous among those which are highly pictorial rcent 
d its m 
some notion of our conception of the meaning of democracy an 
tribution to preserving and making democracy work better. \? qure 
; ic 
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the remaining twelve pages with a moderate amount of text and about 
20 percent pictures. Graphs are pictorialized in various ways. The Rochester 
budget for some years has been an inspiring publication. Its present 
character took form in 1936; its earlier popular form dates back to 1927. 
(c) The Fostoria, Ohio, report for 1941 (31) carried about 90 percent 
pictures. Three pages were “thermometers,” showing the ratings of the 
schools on eighteen aspects according to the Cooperative Study of Sec- 
ondary School Standards. It is interesting as a report of a relatively 
small city. (d) The Chicago report for 1941 (22) was profusely illustrated 
(about 30 percent of space) thru some 500 pages, followed by about 
fifty pages of tables. (The report covers the years 1936-41.) It was or- 
ganized around activities in the school curriculum which were of im- 
mediate interest to parents and the general public. (e) In addition to 
these reports for individual cities we should mention a popular report 
of the U. S. Office of Education (88) which utilized pictorial and dia- 
grammatic material to portray its manifold activities. There was no 
Separate text. . 

As treatises on the preparation of reports in business and city goye 
ment, five references will be cited (8, 70, 75, 77, 78). Other refe/: 
may be found in the card catalog of libraries under “Reports; 
tion” or “School Reports”; in the Education Index under * : 
Records"; and in the U. S. Office of Education annual Bib 
Research Studies in Education under “School Management: 
Records.” 


Reports and 


Visualized Presentations of Research Findings 

. While the reports of activity and status referred to in the preceding sec- 
tion relied largely upon photographs, because of their appeal and por- 
trayal value, reports presenting research results, survey findings, and sum- 
marized data have made more use of one form or another of graphs. Thus 
the Regents’ Inquiry of New York State summarized the results of ‘fifteen 
printed volumes and many typewritten and mimeographed reports ds 
6-page Primer (39), consisting of one or two sentences of text on ian 
Page with a pictograph occupying the rest of the space. In the e 
the New York State Education Department published a bulletin te : 
Consisting of thirty-six full-page pictographs with a short paragraph o - 
accompanying each, to present a brief history of the schools of the state 
sd their problems. The American Youth Commission's Youth Tell = 
c; A (9) contained sixty-two charts and pictographs one diagram iis 
Med 3% Pages of text—in addition to ninety-nine a (79) de- 
per entation of factual material on growth during adolescence he ot 
nded Wholly on graphs and pictures, with accompanying ny ea e 
lion; there was no separate text. Goodykoontz departi -9 
nal style of the U. S. Office of Education summary Bal eei of 
tting ordinary tables and diagrams and introducing a num 
alized graphs. 


Taditio 
Y omi 
Pictori 
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Other Visualized Factual Material for the Nontechnical 
Consumer 


We shall refer here briefly to several other publications which are good 
examples of the technique of presentation being discussed. The War 
Department innovation in a textbook (89) which is devoid of text apart 
from brief comments on the graphs is interesting both because of its 
subjectmatter and its form. A graphic history of the United States (40) 
has about one-third of its space given over to an ingenious variety © 
pictographs. The magazine Building America, published by the Americana 
Corporation for the Society for Curriculum Study and now in its eighth 
volume, gives roughly 40 percent of its space to text and 60 percent to 
pictures and graphs. The set of pamphlets published each year by the Trav- 
elers Insurance Company (Hartford, Connecticut) on automobile accidents, 
for free distribution to schools, and the annual publication Accident Facts 
(55) are excellent examples of how simple, “dry” statistics can be made 
most attractive. Hoban, Hoban, and Zisman (41: 198-207) not only dis- 
„cussed visualized textbooks but prepared a treatise on visual materials fer 
"* maom use which may itself be cited as an example of visualized text- 
Mblic Affairs Pamphlets (distributed to schools by Silver Burdett) 
4 line Books of the Foreign Policy Association are active serie? 
ci stensive use of pictographs. : 

INeürath's semipopular treatise on modern man (59) included many P! 
torial diagrams which he states “do not merely act as illustrations or 25 
eye-bait; they are parts of the explanations themselves” (p. 7). As other 
examples of books in which the visual material is integrated with a 
text and forms a part of the continuity, instead of serving mere y n 
exhibits, we may mention two books by Caldwell and Bourke-White es 
18) which represent photographic and verbal reporting of America? ae 
A publisher’s blurb states: “Two creative artists have developed and mé 
tered an original and brilliant pattern of book-making. The face 0 
nation has never before been recorded so richly as here.” 


An Outstanding Graphic Development: Pictographs 


One cannot read the references in the two foregoing section ositio® 
realizing that a new type of graph has come to occupy a leading P^: the 


. er 18 
among graphs designed for popular consumption. This newco™ arative 


Pictograph. It not only does an admirable job of presenting s bee? 
quantities but, in the capable hands of its leading exponents, It ; we caus 


adapted to clarifying and presenting complex relationships, including pic 
and effect and story sequences. In spite of doubts and inhospitality ades» 
have been prevalent among technical workers during the past tW? graphic 
this type of graph has swept into indisputable dominance of the P olved: 
field wherever relatively popular reports of a few quantities are ió ated t° 

The pictograph is essentially a series of suggestive symbols r in the 
form pictorial bars. There are other developments of pictogtaP”™ 
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realm of maps and sequences, which involve primarily simplification and 
suggestion. The pictograph is not appropriate where curves are called for; 
but frequently the popular graph can, and should, be simplified to the point 
where a few values will suffice in place of the larger number of observa- 
tions giving rise to a smooth curve. At a meeting of the American Statis- 
tical Association in Chicago (December 28, 1940) devoted to “Principles 
and Procedures for Putting Across Business-Statistics Reports to Execu- 
tives,” several speakers and other commentators expressed dislike and dis- 
dain for the pictograph. It was regarded as a highly complicated and frilled 
device which commonly ends in fractions of a symbol and generally dis- 
tracts one’s attention from the main point. Brinton (12: 12-13), in his 
Preface, implies that it was developed in countries where the people had 
a low level of literacy and is something of a “weed” in America. It seems 
. Probable that the professional statistician, thinking only of a technical or 
intrinsically interested reader, will view such graphs differently from what 
the general reader will. Pictographs, where they are well designed, catch 
one's attention, getting many a reader to pause long enough to look at 
the graph. They hold the attention on each bar, or category, longer thar 
a simple printed label would, thus giving time for more comprehens 
They add an emotional element of interest, enjoyment, and sati: 
to the bare facts which are presented. And, again when they are și 
they represent a careful analysis of the problem and a simpli. 
the most important aspects so that the main points stand out clearly—which 
is just what a graph should do. If they go further in this direction than 
the highly trained statistician would go, perhaps the statistician needs more 
training along the line of how the common person thinks. y 
The pictograph was developed in a social science museum in Vienna 
during the early “twenties, principally under the sponsorship of Otto 
Neurath, with Rudolf Modley as a member of the staff. While earlier 
Isolated instances of this type of graph were produced or quoted in several 
lextbooks (1; 12: 122-24; 73; 74), in the United States nothing was done 
to exploit its possibilities. Modley came to America in 1939, joining the 
Staff of the Chicago Museum of Science and Industry. In 1934 he helped 
found, and became executive director of Pictorial Statistics. This agency, 
Which renders a commercial service to schools, authors, and publishers, 


as lately used the name of Pictograph Corporation because its on 
extended to include nonstatistical graphing. Neurath left Vienna in 19 
ation for Visual Education 


and helped establish the International Found 
at The Hague, Holland. He is now at Oxford, England. : 
he movement which developed the pictograph has involved Er pre 
than just drawing graphs; it has embodied the searching for socia eus 
and relations which are of importance to present. Tt has lead to socia 
museums, foundations, and a great increase of interest in social pars 
e history of the movement to 1937 was presented by Modley (47: 


hapter 13). 


jc 
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Examples of pictographs are far too numerous to mention here. d 
of the reports cited in previous sections employ them (9, 39, 40, 59, h 2 
89, and others). Modley (47: 158-66) gives an extensive bibliography 
for publications in Europe and in the United States to 1937. 


Treatises on the Production and Use of 
Pictographs and Other Graphs 

The principal discussion of pictographs and methods of making pe 
is by Modley (47) in 1937, a work which is now being revised. p "s 
brief discussion of types of pictograph to portray various facts ( * 
probably not widely available. Other discussions, however, serve to TO E 
out the picture (41: 242-47, 48, 49, 50, 95). Three of these eot 
(41, 48, 50) deal particularly with the use of pictographs and ria 
charts for teaching purposes in the classroom. A catalog of 1000 Piciri 
Symbols (63) has been published illustrating pictograph symbols W cael 
are available for use by others (cost, 5 cents each, to schools). Two mg 
books by Neurath (57, 58) discuss the use of pictographs for an mM 

. national symbolic language. "ted in the 

; as point that is likely to be overlooked by the novice and omitte c more 

ses is that the success of a pictograph depends upon ene an 
ver symbols. The production of a good graph involves, vedi ; 

“gnithe principal facts or elements of the story to be repres nt 85 

E ; the selection of the appropriate type of graph; third, as em is 4 
to proportion, titles, legends, and so forth, so that the final pee 
graph that is simple, clear, bold, engaging, and accurate in the impe an 
it conveys. A successful graph depends far more on careful thoug 
judgment than on technique. 

This section is not concerned with graphing in general but 
graphs which are particularly important in the reporting of re 
summarized facts. In this connection we note two publication 
importance (4, 5) by committees of the American Society of t writing 
Engineers. These reports (one of which is in press at the Les re som 
represent a long-delayed answer to hopes which were engen “andato? 

- twenty-eight years ago when a committee was set up to produce ° gue 
for graphic presentation. The preliminary report, published mrded pi 
1915, was reproduced in many textbooks, but was generally A have je 
something of a makeshift. It is therefore a great satisfaction to roups 9 
tensive, detailed, and authoritative reports covering two large & into? 
graphs—time-series charts, and engineering and scientific grap e 
pioneer treatise on graphic methods (in 1914) has been SUP^ y gettin? 
a revised edition (12) which, though it lacks the adequa 
of the earlier volume, presents a great variety of grap 
One further reference (68) may be of interest since 1t reve tises 
graphs from the point of view of a cartographer. Other Ta catalog 
found by consulting the head “Graphic Methods” in the car 
a library or in the Education Index. 
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Implementing Programs and Publications 


A brief note on implementation will close this chapter on reporting and 
also finish this research volume which was appropriately begun with a 
discussion of library procedures. Getting research into practice completes 
the research cycle—and also begins a new one, for further research will 
have to be done on how well a device or procedure works in practice and 
how to improve its functioning in practice. 

According to the new Webster's Dictionary of Synonyms, published this 
fall, the verb “implement”? “has seen rapid development in its implica- 
tions . . . especially since early in the third decade of the twentieth cen- 
tury”—which was about the time it greeted our ears on every hand in 
educational conventions and deliberative committee meetings. The word 
"usually" suggests reference to . . . proposals or projects which have 
been accepted, policies which have been adopted, and the like, and implies 
the performance of acts that definitely carry them into effect or ensure 
their being put into operation.” 

In a sense, every educational organization in the country is engaged in 
implementing its program, and so far as this deals with educational 
Search, it is deserving of recognition here. We must therefore content 
selves by referring to a few outstanding examples of what is ge 
Somewhat widely. The Implementation Commission of the Nati x$ 
ciation of Secondary-School Principals has been at work for sever 
Stimulating publications which help translate general principles into terms 
of definite school action. The Discussion Group Project, begun in 1937, 
is another outcome of the work of this Commission. The Cooperative Study 
in General Education and the Commission on Teacher Education, both. of 
the American Council on Education, and the Stanford Social Education 
nvestigation are other examples of implementing work—concerned with 
Carrying significant facts and research findings to the cooperating institu- 
Hons and developing applications. 

The Progressive Education Association Commission on the Secondary 
School Curriculum published, through various subjectmatter pu p. 
aà number of implementing treatises. Reference to one of these us ma 
will serve as an example. The treatise on science (65) not ay ae 
the general program but contains a chapter on “How the Teac! er 7 

ake Use of the Report” and gives several extended ie UM a 
“cience units, Reports of the National Committee on Science Teac ing o. 
the American Council of Science Teachers helped further fo M 
Feneral policies in this same area. A recent series of jns m E e 
of S. Office of Education represent an implementation of our ganmi m 

teaching democracy and the fundamental issues of the war in the p 


Schools, The new series of pamphlets on problems in American life (54) 


I5 instructi i i belief that contemporary prob- 
lonal material to implement a book of the Ameri- 


“ms should be taught in the high school. The joint year 
o| g SI 
can Educational Research Association and the Department of Classroom 
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Teachers (3) is an example of attempting to implement all educational 
research which bears directly on teaching. Further details and other pate 
ples of implementation will be found in the general summaries of researc a 
activities by Carr (20), Good (32, 33), and Scates (76), cited earlier, 
and in Good's section, “Research News and Communications,” appearmg 
monthly in the Journal of Educational Research. A committee of the Amer- 
ican Council on Education outlined implementing practices and principles 


(2a, 38a). 


Summary Statement 


al relation of research 


A number of writers have commented on the gener. e are 
m 


and classroom practice (3, 13, 14, 15, 25, 38, 53, 82, 05). So Ji 

impatient that research findings are not more quickly and more genera d 
introduced into the classroom. Some think the difficulty lies in pco 
and improper reporting of research. The basic attitude seems to be; hat we 
is worth knowing is worth putting into practice.” The difficulty is tha at 
do not know something as quickly as we are likely to think we do. the 
the teacher or administrator may regard as proved beyond eed 
rere cautious research worker may regard as only in the beginnen 


É 4 ationa 
loration. It is certain that we shall do both research and educ j 
^. very stud) 


Much o our 


oi once be made available for putting into practice. a 
research is for science rather than for practice, and all researc 
mellowing. The best course for getting research into practice i minis" 
more widespread and direct reporting of findings to teachers a ittees 


A nn 
trators but rather thru more deliberative and implementing eit the 
which will carefully weigh results in a broad field of study, iore apt 

. B H H H : 
findings into consistent theories, express principles in concrete ter Ber 


generalizations to local conditions, try out recommendations, vá com 
offer conclusions for general action by workers in the schools. oe do 
mittees of teachers and administrators who have some research pos fut’ 
and who understand that the applications of “raw” findings 1n" 
ther study and research, can often help in the process. speci? P. etand® 
they work in cooperation with a university professor who un ut they 
both research and teaching. Such procedures take time, yes 


represent the only safe course for both the schools and researc” 
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Cultural factors, 347 
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Current events, 305, 526 
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proaches, 259 


Deaf and hard of hearing, adjustment, 507 

Deans, 125; of women, 130 

Defense, see national defense 

Democracy, 22, 263, 291, 295; in leader- 
ship, 77; teaching, 261, 347 

Depreciation, 230 


> $ Diagnosis, of learning, 395, 485; of per- 


songlity and adjustment, 46 
Diffciflty, of test items, 543, 546, 552 
Directories, 463, 464, 466 
Discipline, 22, 282 
Distance from school, 24 
Documentary analyses, 437 
Drama, 305, 372 


Economic outcomes of education, 523 

Economies, 229 

Education and society, 521 

Educational opportunity, 86; equalization, 
157; family factors, 11, 96 

Educational philosophy, 259, 289 

Educational psychology (as a field), 280, 
345 ' 

Eight-Year Study (of Progressive Educa- 
tion Association), 265, 275, 283, 364, 
417, 526 

Emotional climate, 21 

Emotions, 350 

Employment, and age, 96 

English, error studies, 498; grading com- 
positione, 511; grammar, 498 

Enrichment, 28, 278 

Environment, and the pupil, 346 

Error studies, 425, 486, 498 

Equipment, 203, 230; bibliography, 203; 
needed research, 203 

Essay tests, grading, 526, 546 

Evaluation, 348; of educational institu- 
tions, 521; of pupil competence and 
behavior, 33 
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Evaluation Staff (of the Progressive Edu- 
cation Association), 34 

Evaluative studies, methods, 522, 528 E 

Experimentation, design, 515; matche 
groups, 516; technique, 501 4 

Extracurriculum activities, 68; partici- 
pation, 68; scholarship and, 70, 72 

Eye-movement studies, 6, 505 


Factor analysis, 542, 552; evaluation, 543 

Failure, 27, 29 

Farming, 96 

Fatigue, 71 " 

Federal support for education, 162 

Field trips, 339; evaluation, 339 32 

Floors, cleaning, 232; maintenance, ee 

Follow-up studies, 58, 88, 98, 112, 115, 
436, 492, 523, 535 

Foreign education, guidance, 119 

Former students, 523 

Fraternities, 73 

Freedom, of will, 297 

Frequency studies, 563 

Frustration, 350 > 

Functional aspects of learning, 33 


Galvanometric studies, 396 

General education, 274 

Generalization, 345, 372, 425 

Generic research, 6 

Genetic research, 482 

Geometry, 425, 430 

German education, 347 scion 

Gifted children, educational provisio 
for, 28 

Government, reports, 565 1 

Grade placement, 340; of subjectmatter: 

Graphs, 565, 568; pictographs, 566 

Group interaction, 8 be 

Groups, 21, 66, 73; effect on mem 
10, 78; members, 69 5,9; 

Growth and development, curves, i 
growth studies, 5; needed rea is 3 

Growth and development (of individu 
36 , isal, 

Guidance and counseling, 66; een 
79, 88; foreign, 119; fundamenta ^ in 
ditions, 21, 67; group guidance, 66: 7) 
college, 91, 115; in elementary » 120, 
86, 110, 124; needed research, 8C. 76 
132; practices, 89; programs; | a fors 
109; techniques, 67, 76; trainin 
124; vocational, 87 d 

Gymnasium, 205 
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and, 
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Health services in schools, equipment, 205 

Heating, 230; equipment, 206 

High-school pupils, 8 

Higher education, appraisal, 522; cur- 
riculum, 92 

Historical method, 466 

History, bibliography, 465 

Home and family life, education for, 15 

Home arts, equipment, 205 

Homeroom, activities, 75; guidance, 89 

Home study, 398 

Homogeneity of data, 506 

Housing, 162, 246 

Hypotheses, 504 


IBM machines, 550 

Incidental teaching, 

Income (personal), 99 

Individual differences, 512; in science, 380 

Individualized instruction, 302 

Industrial arts, equipment, 205 

Insurance, accident, 242; legal aspects, 
247; liability, 248 

Intangible outcomes, 21; 
284 

Intelligence, achievement and, 12, 47; 
activities and, 69; environment and, 6; 
prediction, 5 

Interests, 50, 295, 312; in study, 31; 
measurement, 349 

Interpersonal relations, 76, 482 

Interpretation of data, 34 

Interviews, 51, 536; evaluation, 52; in 
teaching, 537; recording, 537; relia- 
bility and validity, 53; vocabulary, 537 

Jsochrons, 6 

Ttem analysis, 546, 552 


7; arithmetic, 387 


appraisal, 34, 


Janitors, 228, 245 
Judgments, 52, 511 
Junior colleges, 92, 117 


Kindergertens, equipment, 205 


Laboratcries, 204 

Laboratory method, 418 

Language, studies of, 497 

Leadership, 10, 69, 71, 75, 77, 351 

Learning, distribution of practice, 
515; studies of, 346 

Lecture method, 300 

Legal research, methods, 468 

Legislation and court decisions, 182; bib- 

- liography, 468 

Letter writing, 497 

Liability, 241, 248 

Liberalism-conserva! 


508, 


tism, 13, 78, 417, 503 


Libraries, 323; adult education and, 329; 
bibliography, 323; college, 323, 328; 
cooperative programs, 325; costs, 326; 
evaluation, 324, 326; function, 323; 
high school, 323; instruction about use, 
329; needed research, 330; school, 323; 
surveys, 324; use of, 321 

Life activities, 436 

Lifelike situations, 7, 73, 436 

Lighting, 206, 211; amount needed, 198, 
213; glare, 216; needed research, 215 

Longitudinal studies, 5, 529 

Lunchrooms, 197, 205 


Maintenance, of grounds, 229; of school 
plant, 228 

Maps, reading of, 340 

Marriage, attitudes toward, 13 

Matching (complex), 36 

Mathematics, 425; approximate computa- 
tion, 406; bibliography, 363; curricu- 
lum, 405, 430; diagnosis, 431; equip- 
ment, 408; extraschool education, 435; 
intelligence and, 427; junior high «> 
school, 405; measurement, 40€; ob- 

405; predictions, 408, 427; 
reading and, 407, 429; remedial instruc- 
tion, 431; science requirements, 432; 
sex differences, 407; teacher education, 
443; teaching, 430; textbooks, 408; 
visual aids, 408; vocabulary, 407, 429; 
see also arithmetic 

Maturation, 5 

Measurement, vs. evaluation, 34 

Mental development, 6; prediction, 5 

Methods of teaching, 299 

Microphotography, 340, 469 

Mobility, of population, 157 

Morale, 8, 14, 348 . 

Motion pictures, 438; appreciation, 338; 
equipment, 339; in education, 337; pro- 
duction, 338 

Motivation, 50, 316 " 

Music, learning, 515; piano 515 


jectives, 


National defense, 162; trade training, 165 
Nature and ap 6 
S rch, equi 
Needed redd ; guidance, 80, 120, 
132; libraries 30; lighting, 215; 
science, 448; war conditions, 366 
Negro education, housing, 192, 195 
Negroes; youth, n a 
New York City activi 
282, 364 
Newspapers and maga 


ty experiment, 277, 


zines, 437 
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Nonpublic education, public money for, 
243 

Nonschool educational agencies, 435 

Nonteaching personnel, 228 

Norms, 420 

Null hypothesis, 501, 504 


Objective tests, length, 504; reliability, 
504 

Objectives, 292, 528 

Observation, as a research technique, 481; 
of behavior, 8, 36, 76; of social life, 495 

Occupational surveys, 95 

Occupations, changing conditions and re- 
quirements, 94; classification, 93; fa. 
thers and sons, 10, 96 

Office equipment, 205 

Operation of school plant, 180, 230 

Out-of-school activities, 436 

Outcomes of education, 21, 530; changes 
in behavior, 419 


Painting, of buildings, 231; of classrooms, 


218, 231 

Parti§jpation, in administration, by stu- 
dents, 72, 75 

Perception, 6 

Periodicals (professional), evaluation, 


563; lists and indexes, 460, 464, 465 

Persistence, 351; in school, 24 

Personal documents, 480 

Personal problems, 117 

Personal values, 10 

Personality, 349, 479; development, 10, 
21; environment and, 21; factor analy- 
sis, 538; handicapped children, 507; 
patterns, 14, 483; physical bases, 481 

Personality measurement, 349, 479, 537; 
approaches, 479, 497. evaluation. of 
tests, 538; observation, 479; qualitative 

aspects, 479, 484; scoring, 51, 553 

Philosophy, 290; value, 293 

Phonograph, in schools, 314; transcrip. 
tions, 314 

Photographic recording, sociological, 566 

Physical defects, 24 

Physical development, 5, 12 

Physics, 413, 432 

Physiological maturity, 5 

Pictographs, see graphs 

Pictures, 340, 564 

Plans for pupil grouping, 28 

Play, therapy, 78 

Playgrounds, 206; see also sites 

Plumbing, 203, 205, 233 

Political theories, 13 
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Population, changes, 143, 156; density, 
156; prediction, 158 

Postwar reconstruction, 366 

Prediction, 46; of college success, 13, 46, 
116, 416, 420, 428 

Preschool children, personality, 485 

Primary mental abilities, 11 

Probable error, 505 

Probation of students, 30 

Professional aptitudes, 46, 116 

Progress in school, 497 

Progressive education, 262 

Project method, 300 

Projective techniques, 35, 483 

Promotion of pupils, 26 

Propaganda, 508 

Psychology, bibliography, 463 

Psychophysical measurement, 546 

Psychotherapy, techniques, 52, 78 i 

Public relations, 338, 564; and research, 
564 sion. 38 

Pupil personnel services, organization, 

Pupil-teacher ratio, 412 

Pupils, 5 


Purchasing, 


specifications, 203 


Questionnaires, 523, 534; administration, 
535; preparation, 534; reliability an 
validity, 535; sampling, 535 


Radio, 305; bibliography, 305; compre 
hension, 313; education, 311; education 
by, 373; equipment, 307; eval ee 
309, 315; production of programs, i: 
314; programs, 308; public addre S 
206; research, 306, 559; science educ 
tion, 438; training, 315 . 1 

Rating, of pupils, 526; self-rating, 3 stu- 

Reading, achievement, 6; colege jes, 
dents, 13; diagnosis, 485; difficult t$ 
486; errors, 486; growth, 6; Wee 
12, 328; prediction, 6; sex differen 
327; sociology of, 328 

Reasoning, studies of, 514 3 

Records, personnel, 31, 36; test, 33 ions 

Recreation, equipment, 206; provisi 
for, 146 ) 527 

Regents’ Inquiry (New York State): 

Regional testing, 495, 553 4; 

Reliability, Calculation of, 503, 506, ye 
concept of, 506, 544; Kuder-Richar 
formula, 506, 544 

Religious education, 74 a 

Renting school quarters, 244, 245 
eorganization, 238 

Reports, annual report of 
564; technical, 562 


superintendent, 
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Research, applications, 558, 570; bibli- 
ography, 463; consumers’, 559, 561, 570; 
evaluation of, 559; implementation, 
569; "pure" vs. applied, 559; reporting, 
517, 558, 562, 565; summaries, 560, 562; 
synthesis, 559, 560 

| ow techniques, social development, 

84 

Retardation, 29 

Retarded children, 28, 494; curriculum, 
278, 405 

Retention, 407, 414 

Review of Educational Research, 460, 468, 
561 

Rorschach technique, 484 

Rural culture, surveys, 494 

Rural education, 207; housing, 144, 154, 
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Safety, 189, 193, 198, 230 

Sampling, 494; procedures, 535; theory, 
543 

School buildings, adaptation to educa- 
tional programs, 168; architecture, 168, 
178; bibliography, 169; codes, 238; con- 
struction management, 168; contracts, 
187; costs, 191, 194, 224; designing, 
168, 178, 191, 224; functional design, 
141; legislation and court decisions, 
182, 241; national defense and, 162; 
needs, 151, 162, 164; planning, 145, 168, 
193; teachers’ rooms, 199; trends, 178, 
191; see also equipment, maintenance, 
operation 

School population, characteristics, 5; num- 
ber and change, 23, 156 

School subjects, evaluation. by alumni, 
436, 523; evaluation by students, 88 

Science, 412; auditory aids, 373, 381, 438; 
bibliography, 363; clubs, 439; college, 
412, 416; curriculum, 370, 376, 412; 
elementary school, 369, 444; equipment, 
204; evaluation, 418; experiential back- 
ground, 381; extraschool education, 
435; general science, 375, 376, 446; in- 
terests, 375, 415, 439; junior high, 375; 
misconceptions, 417; needed research, 


366, 448; objectives, 369, 416; offer- 
ings, 412; outcomes, 417; philosophy 
0, 432; 


and, 291, 295; predictions, 42 
sex differences, 375, 415, 439; super- 
stitions, 417; teacher education, 204, 
443; teaching, 301, 369, 375; visual 
aids, 338, 340 

Scientific attitudes, 378, 417 

Scientific method, 379 


Scoring, 51, 502, 546; correction for guess- 

_ ing, 546; machine, 553; weighted, 553 

Seating, 142, 204 

Secondary education, appraisal, 522, 526 

Secondary schools, accrediting, 522; ap- 
praisal, 526 

Selective factors, in college attendance, 
15; in school attendance, 11, 24, 47, 96 

Self-report, 480; validity, 538 

Semantics, 497 

Sex, attitudes, 13; education, 15 

Sites, 171, 176; legal aspects, 173, 243; 
surfacing, 198, 206 

Size of classes, effect on learning, 337 

Slide rule, 431 

Social adjustment and behavior, 8, 10, 73 

Social background of education, 151, 292, 
347 

Social maturity, 6; measurement, 35 

Social outcomes of education, 158, 526; 
evaluation, 524 

Social processes, 77 

Social research, 347 

Social sciences, bibliography, 465 

Social studies, bibliography, 465; cur- 
riculum, 274; equipment, 205 

Social surveys, 494; methods, 151, 494 

Socio-economic status, health and, 24; 
measurement, 152, 154; surveys, 152 

Sociology, bibliography, 465 

Sociometry, 77 

Sound recording, 52, 396 

Spearman-Brown technique, 503, 544 

Special rooms, 170, 205 

Spelling, diagnosis, 487; psychology, 6 

State departments of education, 169 

State school administration, 237 

State support for education, 237 

Statistical methods, 501, 542; bibliog- 
raphy, 542; high school, 405 

Statistics, reporting, 562 

Stenographic recording, 53 

Student government, 72 

Student publications, 76 

Study, habits, 380; methods of, 30 

Style (in formal reports), 562 

Success, in life, 71; in school, 29, 526 

Superstitions, 350, 379 

Survey courses, in science, 

Surveys, city, 493; guidance, 
492, 493; state, 492 

Swimming pool, 205 

Syndromes, 483 

Synthesis, of evidence, 484, 486 

33, 550; coding, 552 

legislation and 
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court decisions, 546; of higher institu- 
tions, 249; of school property, 246 

Teacher education, 443; for guidance 
work, 124; in-service, 448 s 

Teachers, out-of-school activities, 445 

Tension, 78 

Territorial units, legal aspects, 247; re- 
organization, 238 

Tests and scales, construction, 542 

Tests of significance, 543; for differences, 

- 502, 507 à 

Textbooks, analysis, 376, 397, 432, 445; 
appraisal, 397, 408; difficulty, 397 

Tues guides to, 462, 465; standards for, 

Thinking, 345; careful, 425; measure- 
ment, 34; teaching, 425 

Betten of training, 345, 425 
Transportation of pupi 

Twins, 346, 505 UNS 148 


Unit plan of tea 


chi; 
Urban culture, 151 ps 


; Valiy, 545 
Variability, in classes, 510 
ance, 512; within cl; 


; in perform- 
Ventilation, 230 


classes, 29 


Villages, surveys, 494 

Visual aids, 374, 382; in education, 336, 
566; equipment, 339 

Vocabulary, adults, 498; burden, 377; 
children, 498; frequency studies, 397, 
498 

Vocational adjustment and success, 73, 
87; surveys, 523 

Vocational aptitudes, 48 

Vocational education, housing, 142 

Vocational information, 87, 97 

Vocational interests and choices, 10, 14, 
50, 86, 91; in relation to employment 
opportunities, 10 

Vocational opportunities, 28, 93, 96 


Weighting, 51, 546 

Whole child, education of, 7, 36 

Windows, 211 

Women, legal status, 96 

Workbooks, 383, 397 

World War II, college education, 416; 
needed research, 366 —— — 


Youth, guidance, 118; needs, 99; out-of- 
school, 144; surveys, 9, 526 


| Z-transformation, 501, 505 
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